boots.com
robots.txt

Robots Exclusion Standard data for boots.com

Resource Scan

Scan Details

Site Domain boots.com
Base Domain boots.com
Scan Status Ok
Last Scan2024-10-04T04:54:05+00:00
Next Scan 2024-10-18T04:54:05+00:00

Last Scan

Scanned2024-10-04T04:54:05+00:00
URL https://boots.com/robots.txt
Redirect https://www.boots.com/robots.txt
Redirect Domain www.boots.com
Redirect Base boots.com
Domain IPs 192.230.66.56, 45.60.228.56
Redirect IPs 103.28.249.56
Response IP 103.28.249.56
Found Yes
Hash 471368cb3ae2dd643beb09606b4dd9ae27fbfa5c37a6bf1728f154e6d98b87dd
SimHash e395d370e937

Groups

*

Rule Path
Disallow */sessionid/*
Disallow */CMSContent/*
Disallow */CMSCategory/*
Disallow /webapp/wcs/stores/servlet/*
Disallow /search/*
Disallow /number-seven
Disallow /*PrescriptionListingView*
Disallow /*ProductListingViewRedesign*
Disallow /*?bvstate
Disallow /content/
Disallow /en/
Disallow /*notfound-searchdisplaygooglebot*
Disallow /*CategoryDisplay*
Disallow /AnalyticsPageView
Disallow /AnalyticsPageViews
Disallow /*?affwin
Disallow *?namespace=s7classic*
Disallow *?cm_mm*
Disallow *?utm_source*
Disallow /*CheckoutLoginView
Disallow /*boots-account-details
Disallow /*functional-pages/
Disallow /*AjaxOrderItemDisplayView
Disallow /*checkout/
Disallow /AjaxLogonForm*
Disallow /BootsLogonForm*
Disallow /UserRegistrationForm*
Disallow /OrderDetail*
Disallow /WishListDisplayView*
Disallow /online/api/search/v2/multiple-query/

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /shop-online

pinterestbot

Rule Path
Disallow /sitesearch

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.boots.com/sitemap_11352.xml