astroman.dev
robots.txt

Robots Exclusion Standard data for astroman.dev

Resource Scan

Scan Details

Site Domain astroman.dev
Base Domain astroman.dev
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-15T17:11:46+00:00
Next Scan 2025-06-29T17:11:46+00:00

Last Successful Scan

Scanned2025-01-02T14:58:31+00:00
URL https://astroman.dev/robots.txt
Domain IPs 104.21.91.108, 172.67.215.246, 2606:4700:3035::6815:5b6c, 2606:4700:3037::ac43:d7f6
Response IP 104.21.91.108
Found Yes
Hash 90d24bc3bf698ac1e173739502298ccca72adf1f564fab05f484b8c48d1cadd2
SimHash c44044004593

Groups

*

Rule Path
Disallow

Comments

  • https://www.robotstxt.org/robotstxt.html