thecatcity.com
robots.txt

Robots Exclusion Standard data for thecatcity.com

Resource Scan

Scan Details

Site Domain thecatcity.com
Base Domain thecatcity.com
Scan Status Ok
Last Scan2025-10-28T10:51:36+00:00
Next Scan 2025-11-04T10:51:36+00:00

Last Scan

Scanned2025-10-28T10:51:36+00:00
URL https://thecatcity.com/robots.txt
Redirect https://thepetcity.co/robots.txt
Redirect Domain thepetcity.co
Redirect Base thepetcity.co
Domain IPs 104.18.2.55, 104.18.3.55, 2606:4700::6812:237, 2606:4700::6812:337
Redirect IPs 104.21.27.62, 172.67.141.194, 2606:4700:3030::6815:1b3e, 2606:4700:3030::ac43:8dc2
Response IP 104.21.27.62
Found Yes
Hash 6ea5ce85d5efafd4d6e37f18de4434115567b4d6fc76fffed132be826d3283b1
SimHash ce0cc9108b93

Groups

*

Rule Path
Allow /
Disallow */amp/
Disallow */member$
Disallow */member/*
Disallow */search
Disallow */app/*

ias_crawler

Rule Path
Disallow

Other Records

Field Value
sitemap https://thepetcity.co/pet_urlset.xml