petersonflags.com
robots.txt

Robots Exclusion Standard data for petersonflags.com

Resource Scan

Scan Details

Site Domain petersonflags.com
Base Domain petersonflags.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-01T09:09:11+00:00
Next Scan 2025-11-30T09:09:11+00:00

Last Successful Scan

Scanned2025-05-05T06:10:49+00:00
URL https://petersonflags.com/robots.txt
Domain IPs 104.21.35.247, 172.67.181.193, 2606:4700:3031::ac43:b5c1, 2606:4700:3035::6815:23f7
Response IP 104.21.35.247
Found Yes
Hash 0e3c2d7ae8e6ee71b9f57dd5cf0c1e1128343006f73d65d49b43606a21bbc6d1
SimHash 61588c514533

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://petersonflags.com/sitemap.xml