Log In Sign Up

mastodon.deepthot.org
robots.txt

Robots Exclusion Standard data for mastodon.deepthot.org

Resource Scan

Scan Details

Site Domain mastodon.deepthot.org
Base Domain deepthot.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-19T11:44:05+00:00
Next Scan 2025-10-17T11:44:05+00:00

Last Successful Scan

Scanned2024-04-01T23:47:15+00:00
URL http://mastodon.deepthot.org/robots.txt
Domain IPs 174.70.12.249
Response IP 174.70.12.249
Found Yes
Hash b67373094bfbf4baff5c1c6ac604e6dd7869264d439d6890a5bedbab7193cbed
SimHash b5d0bf275c6e

Groups

mozilla/5.0 (compatible; wellknownbot/0.1; +https://well-known.dev/about/

Product Comment
mozilla/5.0 (compatible; wellknownbot/0.1; +https://well-known.dev/about/ bot)

No rules defined. All paths allowed.

Back to top

Warnings

  • 1 invalid line.
  • `accept` is not a known field.
  • `accept-encoding` is not a known field.
  • `host` is not a known field.
  • `hostname` is not a known field.
  • `ip` is not a known field.
  • `remoteaddr` is not a known field.
  • `x-forwarded-for` is not a known field.
  • `x-forwarded-host` is not a known field.
  • `x-forwarded-port` is not a known field.
  • `x-forwarded-proto` is not a known field.
  • `x-forwarded-server` is not a known field.
  • `x-real-ip` is not a known field.
Back to top