grpet.com
robots.txt

Robots Exclusion Standard data for grpet.com

Resource Scan

Scan Details

Site Domain grpet.com
Base Domain grpet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-20T17:30:58+00:00
Next Scan 2026-01-19T17:30:58+00:00

Last Successful Scan

Scanned2025-11-20T20:26:51+00:00
URL https://grpet.com/robots.txt
Redirect http://www.pet-dog-cat-supply-store.com/robots.txt
Redirect Domain www.pet-dog-cat-supply-store.com
Redirect Base pet-dog-cat-supply-store.com
Domain IPs 208.71.169.139
Redirect IPs 208.71.169.139
Response IP 208.71.169.139
Found Yes
Hash 666d95ca56f34329943297bff8170b2766273fba3c0db35862eed3f1fa8ce1da
SimHash 2c14cd866dc5

Groups

*

Rule Path
Disallow /shop/phpshop/etc

Comments

  • Disallow all crawlers access to certain pages.