Log In Sign Up

writethedocs.org
robots.txt

Robots Exclusion Standard data for writethedocs.org

Resource Scan

Scan Details

Site Domain writethedocs.org
Base Domain writethedocs.org
Scan Status Ok
Last Scan2025-09-25T18:21:00+00:00
Next Scan 2025-10-25T18:21:00+00:00

Last Scan

Scanned2025-09-25T18:21:00+00:00
URL https://writethedocs.org/robots.txt
Redirect https://www.writethedocs.org/robots.txt
Redirect Domain www.writethedocs.org
Redirect Base writethedocs.org
Domain IPs 104.21.24.200, 172.67.220.125, 2606:4700:3031::ac43:dc7d, 2606:4700:3035::6815:18c8
Redirect IPs 104.16.253.120, 104.16.254.120, 2606:4700::6810:fd78, 2606:4700::6810:fe78
Response IP 104.16.253.120
Found Yes
Hash 9be6dc1014da14a146d36e94a09386a655380ec665c0a32fb339e2fbc1b4fbf5
SimHash 2a053d03a7e6

Groups

*

Rule Path Comment
Disallow Allow everything
Back to top

Other Records

Field Value
sitemap https://www.writethedocs.org/sitemap.xml
Back to top

Comments

  • This robots.txt file is autogenerated by Read the Docs.
  • It controls the crawling and indexing of your documentation by search engines.
  • You can learn more about robots.txt, including how to customize it, in our documentation:
  • * Our documentation on Robots.txt: https://docs.readthedocs.com/platform/stable/reference/robots.html
  • * Our guide about SEO techniques: https://docs.readthedocs.com/platform/stable/guides/technical-docs-seo-guide.html
Back to top