mastodon.audreywatters.com
robots.txt

Robots Exclusion Standard data for mastodon.audreywatters.com

Resource Scan

Scan Details

Site Domain mastodon.audreywatters.com
Base Domain audreywatters.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-18T07:18:11+00:00
Next Scan 2024-08-16T07:18:11+00:00

Last Successful Scan

Scanned2023-05-01T04:24:39+00:00
URL https://mastodon.audreywatters.com/robots.txt
Domain IPs 104.26.6.118, 104.26.7.118, 172.67.69.79, 2606:4700:20::681a:676, 2606:4700:20::681a:776, 2606:4700:20::ac43:454f
Response IP 104.26.7.118
Found Yes
Hash 69fa932c8ee11467d8b4d62648dda630e6b1f28546b071e29bee873516a33be0
SimHash a8541b857762

Groups

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file