mastodon.pfeifer.dev
robots.txt

Robots Exclusion Standard data for mastodon.pfeifer.dev

Resource Scan

Scan Details

Site Domain mastodon.pfeifer.dev
Base Domain pfeifer.dev
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-09-29T06:27:17+00:00
Next Scan 2025-12-28T06:27:17+00:00

Last Successful Scan

Scanned2023-05-20T11:20:39+00:00
URL https://mastodon.pfeifer.dev/robots.txt
Domain IPs 65.185.68.136
Response IP 65.185.68.136
Found Yes
Hash 69fa932c8ee11467d8b4d62648dda630e6b1f28546b071e29bee873516a33be0
SimHash a8541b857762

Groups

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file