petco.com
robots.txt

Robots Exclusion Standard data for petco.com

Resource Scan

Scan Details

Site Domain petco.com
Base Domain petco.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-22T05:23:49+00:00
Next Scan 2025-12-21T05:23:49+00:00

Last Successful Scan

Scanned2023-01-08T15:32:55+00:00
URL https://petco.com/robots.txt
Redirect https://www.petco.com/robots.txt
Redirect Domain www.petco.com
Redirect Base petco.com
Domain IPs 104.18.43.169, 172.64.144.87, 2606:4700:4400::6812:2ba9, 2606:4700:4400::ac40:9057
Redirect IPs 104.18.43.169, 172.64.144.87, 2606:4700:4400::6812:2ba9, 2606:4700:4400::ac40:9057
Response IP 172.64.144.87
Found Yes
Hash ce714979d28339a6b5a950ca4d61d4ef924b5a698f39dc7b9383901fbe195972
SimHash 145740908f13

Groups

*

Rule Path
Disallow /shop/SearchDisplay
Disallow /shop/CategoryDisplay
Disallow /content/petco/PetcoStore/en_US/pip
Disallow /shop/PetcoStoreLocatorDisplayView
Disallow /shop/ChangePassword
Disallow /shop/OrderItemDisplay
Disallow /shop/PetcoInterstitialLogonFormView
Disallow /shop/TopCategoriesDisplay
Disallow /shop/UserRegistrationForm
Disallow /webapp/wcs/stores/servlet/PetcoGuestOrderLookupView
Disallow /webapp/wcs/stores/servlet/EmailPreferencesTransitionalView
Disallow /webapp/wcs/stores/servlet/EmailPreferencesView
Disallow /shop/ResetPasswordGuestErrorView
Disallow /shop/AjaxLogonForm
Disallow /shop/PetcoStoreLocatorDisplayView
Disallow /shop/ShopCartPageView
Disallow /shop/LogonForm
Disallow /shop/Sitemap*catalogId
Disallow /shop/Logoff
Disallow /wishlist
Disallow /shop/PetcoMyPrescriptionView
Disallow /shop/MyListsView
Disallow /shop/RepeatDeliveryListingView
Disallow /shop/OrderCalculate
Disallow /shop/TrackOrderStatus
Disallow /shop/ClickInfo

Other Records

Field Value
sitemap https://www.petco.com/sitemap_10151.xml

Warnings

  • `noindex` is not a known field.