toot.bldrweb.org
robots.txt

Robots Exclusion Standard data for toot.bldrweb.org

Resource Scan

Scan Details

Site Domain toot.bldrweb.org
Base Domain bldrweb.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-01T07:54:30+00:00
Next Scan 2026-04-01T07:54:30+00:00

Last Successful Scan

Scanned2025-08-11T07:46:19+00:00
URL https://toot.bldrweb.org/robots.txt
Domain IPs 104.21.23.213, 172.67.213.237, 2606:4700:3035::6815:17d5, 2606:4700:3035::ac43:d5ed
Response IP 104.21.23.213
Found Yes
Hash fba77ace66a67c92b8c2a06cf676a2eb4c0ac4d3bb53b524a57ba3f482b7e01e
SimHash a874bba4f763

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /media_proxy/
Disallow /interact/
Disallow /api/v1/instance/domain_blocks

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file