petciler.com
robots.txt

Robots Exclusion Standard data for petciler.com

Resource Scan

Scan Details

Site Domain petciler.com
Base Domain petciler.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan5/25/2025, 6:44:11 AM
Next Scan 8/23/2025, 6:44:11 AM

Last Successful Scan

Scanned2/5/2023, 9:14:47 PM
URL https://petciler.com/robots.txt
Domain IPs 104.21.47.58, 172.67.144.220, 2606:4700:3035::6815:2f3a, 2606:4700:3036::ac43:90dc
Response IP 172.67.144.220
Found Yes
Hash 95252c51d0ccd3cb5adf201de59cbd2608a8989a78fee4195af1df6d9d8c36bd
SimHash 280d8a62c6b3

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /petkontrol/

Other Records

Field Value
sitemap https://www.petciler.com/sitemap.xml