petzooie.com
robots.txt

Robots Exclusion Standard data for petzooie.com

Resource Scan

Scan Details

Site Domain petzooie.com
Base Domain petzooie.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-21T01:00:38+00:00
Next Scan 2026-02-19T01:00:38+00:00

Last Successful Scan

Scanned2025-07-24T21:18:42+00:00
URL https://petzooie.com/robots.txt
Redirect https://www.petzooie.com/robots.txt
Redirect Domain www.petzooie.com
Redirect Base petzooie.com
Domain IPs 2a02:4780:84:7456:ed03:c20b:7400:d7a2, 2a02:4780:84:b0f3:ba1a:4df6:f76b:5678, 77.37.75.81, 91.108.100.187
Redirect IPs 2a02:4780:38:3d3f:ac53:666b:31cf:29e1, 2a02:4780:39:a230:223c:8139:d9af:39bd, 93.127.196.155, 93.127.201.10
Response IP 77.37.75.142
Found Yes
Hash bade4402448f9741b8b79ed8b1d35134fd00fc3200454ac730896a039084d77c
SimHash 6d5ddc10a283

Groups

*

Rule Path
Disallow /admin/
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.petzooie.com/sitemap-index.xml
sitemap https://www.petzooie.com/sitemap1.xml
sitemap https://www.petzooie.com/sitemap2.xml
sitemap https://www.petzooie.com/sitemap3.xml

Comments

  • Disallow: */search
  • Optional: reduce or remove crawl-delay
  • Crawl-delay: 10