thepoz.org
robots.txt

Robots Exclusion Standard data for thepoz.org

Resource Scan

Scan Details

Site Domain thepoz.org
Base Domain thepoz.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-07-17T16:47:49+00:00
Next Scan 2025-10-15T16:47:49+00:00

Last Successful Scan

Scanned2025-02-25T10:03:32+00:00
URL https://thepoz.org/robots.txt
Redirect https://www.thesushiscientist.com/robots.txt
Redirect Domain www.thesushiscientist.com
Redirect Base thesushiscientist.com
Domain IPs 104.21.64.101, 172.67.181.22, 2606:4700:3030::6815:4065, 2606:4700:3037::ac43:b516
Redirect IPs 104.21.88.138, 172.67.180.23, 2606:4700:3035::6815:588a, 2606:4700:3035::ac43:b417
Response IP 104.21.88.138
Found Yes
Hash 310af748fb5846e975663e275c69b3b3f62ee459bba301cf025cc0c4057f9d3f
SimHash 4104dc50c711

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.thesushiscientist.com/sitemap.xml