rtfd.org
robots.txt

Robots Exclusion Standard data for rtfd.org

Resource Scan

Scan Details

Site Domain rtfd.org
Base Domain rtfd.org
Scan Status Ok
Last Scan2025-09-24T12:32:37+00:00
Next Scan 2025-10-08T12:32:37+00:00

Last Scan

Scanned2025-09-24T12:32:37+00:00
URL https://rtfd.org/robots.txt
Redirect https://app.readthedocs.org/robots.txt
Redirect Domain app.readthedocs.org
Redirect Base readthedocs.org
Domain IPs 104.16.253.120, 104.16.254.120, 2606:4700::6810:fd78, 2606:4700::6810:fe78
Redirect IPs 104.18.6.29, 104.18.7.29, 2606:4700::6812:61d, 2606:4700::6812:71d
Response IP 104.18.6.29
Found Yes
Hash 7fd482c19744b879d8290cd66ed4b8e4cc674bfa1785786f37c12043b2c47d7f
SimHash f23f8d12ca0b

Groups

*

Rule Path
Disallow /search/
Disallow /api/
Disallow /builds/
Disallow /sustainability/click/

ahrefsbot

Rule Path
Disallow /

Comments

  • This was hitting our site and causing a lot of issues