assets.readthedocs.com
robots.txt

Robots Exclusion Standard data for assets.readthedocs.com

Resource Scan

Scan Details

Site Domain assets.readthedocs.com
Base Domain readthedocs.com
Scan Status Ok
Last Scan2025-09-06T15:42:48+00:00
Next Scan 2025-10-06T15:42:48+00:00

Last Scan

Scanned2025-09-06T15:42:48+00:00
URL https://assets.readthedocs.com/robots.txt
Domain IPs 104.26.14.223, 104.26.15.223, 172.67.72.166, 2606:4700:20::681a:edf, 2606:4700:20::681a:fdf, 2606:4700:20::ac43:48a6
Response IP 104.26.14.223
Found Yes
Hash 7fd482c19744b879d8290cd66ed4b8e4cc674bfa1785786f37c12043b2c47d7f
SimHash f23f8d12ca0b

Groups

*

Rule Path
Disallow /search/
Disallow /api/
Disallow /builds/
Disallow /sustainability/click/

ahrefsbot

Rule Path
Disallow /

Comments

  • This was hitting our site and causing a lot of issues