readthedocs.io
robots.txt
Robots Exclusion Standard data for readthedocs.io
Resource Scan
Scan Details
Site Domain | readthedocs.io |
Base Domain | readthedocs.io |
Scan Status | Ok |
Last Scan | 2025-09-23T00:03:57+00:00 |
Next Scan | 2025-10-07T00:03:57+00:00 |
Last Scan
Scanned | 2025-09-23T00:03:57+00:00 |
URL | https://www.readthedocs.io/robots.txt |
Redirect | https://app.readthedocs.org/robots.txt |
Redirect Domain | app.readthedocs.org |
Redirect Base | readthedocs.org |
Domain IPs | 104.16.253.120, 104.16.254.120, 2606:4700::6810:fd78, 2606:4700::6810:fe78 |
Redirect IPs | 104.18.6.29, 104.18.7.29, 2606:4700::6812:61d, 2606:4700::6812:71d |
Response IP | 104.18.6.29 |
Found | Yes |
Hash | 7fd482c19744b879d8290cd66ed4b8e4cc674bfa1785786f37c12043b2c47d7f |
SimHash | f23f8d12ca0b |
Groups
*
Rule | Path |
---|---|
Disallow | /search/ |
Disallow | /api/ |
Disallow | /builds/ |
Disallow | /sustainability/click/ |
Comments