readthedocs.org
robots.txt

Robots Exclusion Standard data for readthedocs.org

Resource Scan

Scan Details

Site Domain readthedocs.org
Base Domain readthedocs.org
Scan Status Ok
Last Scan2025-09-22T06:40:53+00:00
Next Scan 2025-10-06T06:40:53+00:00

Last Scan

Scanned2025-09-22T06:40:53+00:00
URL https://readthedocs.org/robots.txt
Redirect https://app.readthedocs.org/robots.txt
Redirect Domain app.readthedocs.org
Redirect Base readthedocs.org
Domain IPs 104.18.6.29, 104.18.7.29, 2606:4700::6812:61d, 2606:4700::6812:71d
Redirect IPs 104.18.6.29, 104.18.7.29, 2606:4700::6812:61d, 2606:4700::6812:71d
Response IP 104.18.7.29
Found Yes
Hash 7fd482c19744b879d8290cd66ed4b8e4cc674bfa1785786f37c12043b2c47d7f
SimHash f23f8d12ca0b

Groups

*

Rule Path
Disallow /search/
Disallow /api/
Disallow /builds/
Disallow /sustainability/click/

ahrefsbot

Rule Path
Disallow /

Comments

  • This was hitting our site and causing a lot of issues