# Crawling policy for https://www.doctorojos.com/ # Search and AI visibility use the same public, indexable HTML. User-agent: * Allow: / Disallow: /*.backup$ Disallow: /.DS_Store$ Disallow: /ebooks/.DS_Store$ # ChatGPT Search discovery. GPTBot is covered by the general rule above; # it is a separate control for potential model training, not search ranking. User-agent: OAI-SearchBot Allow: / Disallow: /*.backup$ Disallow: /.DS_Store$ Disallow: /ebooks/.DS_Store$ User-agent: ChatGPT-User Allow: / Disallow: /*.backup$ Disallow: /.DS_Store$ Disallow: /ebooks/.DS_Store$ Sitemap: https://www.doctorojos.com/sitemap.xml