castingpet.com
robots.txt

Robots Exclusion Standard data for castingpet.com

Resource Scan

Scan Details

Site Domain castingpet.com
Base Domain castingpet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-09T16:51:58+00:00
Next Scan 2024-11-07T16:51:58+00:00

Last Successful Scan

Scanned2023-12-21T14:00:39+00:00
URL https://castingpet.com/robots.txt
Domain IPs 13.33.88.19, 13.33.88.33, 13.33.88.55, 13.33.88.94
Response IP 108.156.2.52
Found Yes
Hash b3d19606f280001691ea133e89e07ed7b21583a9cc1b9ccbb9858ec74f83b6ee
SimHash 68595a22edf3

Groups

*

Rule Path
Allow /
Disallow /site_join
Disallow /site_join_agree
Disallow /login
Disallow /logout.cm
Disallow /shop_cart
Disallow /?mode*

yeti

Rule Path
Disallow /private*/

Other Records

Field Value
sitemap https://castingpet.com/sitemap.xml