petcareclub.com
robots.txt
Robots Exclusion Standard data for petcareclub.com
Resource Scan
Scan Details
| Site Domain | petcareclub.com |
| Base Domain | petcareclub.com |
| Scan Status | Ok |
| Last Scan | 2024-04-27T05:02:52+00:00 |
| Next Scan | 2024-05-27T05:02:52+00:00 |
Last Scan
| Scanned | 2024-04-27T05:02:52+00:00 |
| URL | https://petcareclub.com/robots.txt |
| Domain IPs | 192.124.249.108 |
| Response IP | 192.124.249.108 |
| Found | Yes |
| Hash | ab28aa03d008edb8af73a93efd54d7e2c48b62bb17ff0b6c8a34e42da0e6838e |
| SimHash | 69221a40a582 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Customer_Signup.aspx |
| Disallow | /my_cart.aspx |
| Disallow | /check_out.aspx |
| Disallow | /forgot_password.aspx |
| Disallow | /product_search.aspx |
| Disallow | /payment_chk.aspx |
| Disallow | /dog-care-supplies-114.aspx |
| Disallow | /cat-care-supplies-115.aspx |
| Disallow | /forgot_password/Index |
| Disallow | /resetpassword/updatepassword.aspx |
| Disallow | /individualarticle.aspx |
| Disallow | /ProductReviews.aspx |
| Disallow | /productlandigpack/add_to_favourite.aspx |
| Disallow | /Home/ChangeStore |
| Disallow | /productlanding/add_to_favourite.aspx |
| Disallow | /individualarticle.aspx?URLString=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.petcareclub.com/sitemap.xml |