mastodon.sbite0138.net
robots.txt

Robots Exclusion Standard data for mastodon.sbite0138.net

Resource Scan

Scan Details

Site Domain mastodon.sbite0138.net
Base Domain sbite0138.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-19T02:45:13+00:00
Next Scan 2025-08-17T02:45:13+00:00

Last Successful Scan

Scanned2023-02-01T07:33:37+00:00
URL https://mastodon.sbite0138.net/robots.txt
Domain IPs 104.21.10.223, 172.67.146.208, 2606:4700:3031::6815:adf, 2606:4700:3034::ac43:92d0
Response IP 104.21.10.223
Found Yes
Hash 69fa932c8ee11467d8b4d62648dda630e6b1f28546b071e29bee873516a33be0
SimHash a8541b857762

Groups

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file