sainsburys.co.uk
robots.txt

Robots Exclusion Standard data for sainsburys.co.uk

Resource Scan

Scan Details

Site Domain sainsburys.co.uk
Base Domain sainsburys.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-03T05:10:45+00:00
Next Scan 2024-07-02T05:10:45+00:00

Last Successful Scan

Scanned2023-11-29T04:56:17+00:00
URL https://sainsburys.co.uk/robots.txt
Redirect https://www.sainsburys.co.uk/robots.txt
Redirect Domain www.sainsburys.co.uk
Redirect Base sainsburys.co.uk
Domain IPs 23.52.171.208, 23.59.168.163, 2600:1413:1::1720:1d5b, 2600:1413:1::1720:1d62
Redirect IPs 23.52.171.208, 23.59.168.163, 2600:1413:b000:1b::17d7:70d, 2600:1413:b000:1b::17d7:71b
Response IP 23.52.171.208
Found Yes
Hash dc23f3e635cb573c093cfec7ab61e5915ae4a317769ab5e0ff5a7beb6ddccf19
SimHash 2b0275d348e9

Groups

*

Rule Path
Disallow /webapp/wcs/stores/servlet/OrderItemAdd
Disallow /webapp/wcs/stores/servlet/OrderItemDisplay
Disallow /webapp/wcs/stores/servlet/OrderCalculate
Disallow /webapp/wcs/stores/servlet/QuickOrderCmd
Disallow /webapp/wcs/stores/servlet/InterestItemDisplay
Disallow /webapp/wcs/stores/servlet/ProductDisplayLargeImageView
Disallow /webapp/wcs/stores/servlet/QuickRegistrationFormView
Disallow /webapp/wcs/stores/servlet/UserRegistrationAdd
Disallow /webapp/wcs/stores/servlet/PostCodeCheckBeforeAddToTrolleyView
Disallow /webapp/wcs/stores/servlet/Logon
Disallow /webapp/wcs/stores/servlet/RecipesTextSearchDisplayView
Disallow /webapp/wcs/stores/servlet/PostcodeCheckView
Disallow /webapp/wcs/stores/servlet/ShoppingListDisplay
Disallow /webapp/wcs/stores/servlet/gb/groceries/get-ideas/advertising
Disallow /webapp/wcs/stores/servlet/gb/groceries/get-ideas/development
Disallow /webapp/wcs/stores/servlet/gb/groceries/get-ideas/dormant
Disallow /shop/gb/groceries/get-ideas/dormant/
Disallow /shop/gb/groceries/get-ideas/advertising/
Disallow /shop/gb/groceries/get-ideas/development
Disallow /shop/LogonView*
Disallow /webapp/wcs/stores/servlet/SearchDisplayView
Disallow /shop/SearchDisplayView
Disallow /gol-ui/CheckPostcode
Disallow /shop/preLogOff
Disallow /gol-ui/recipes/SearchResults*
Disallow /gol-ui/favourites-as-list
Disallow /gol-ui/oauth/
Disallow /gol-ui/PreviousOrders
Disallow /gol-ui/slot/
Disallow /gol-ui/trolley
Disallow /shop/AddressChange
Disallow /gol-ui/my-account/orders/
Disallow /shop/favourites-as-list
Disallow /shop/MyAccount
Disallow /shop/MyAccountAddress
Disallow /shop/MyCards
Disallow /shop/MyCardsAdd
Disallow /shop/MyCouponWallet
Disallow /shop/MyDeliveryPassView
Disallow /shop/MyDetails
Disallow /shop/MyDetailsUpdate
Disallow /shop/MyNectarCard
Disallow /shop/MyNectarCardUpdate
Disallow /shop/MyPreferences
Disallow /shop/MyTrolleyCheckout
Disallow /shop/QuickRegistrationFormView
Disallow /shop/shop/MyAccount
Disallow /shop/ShopCartDisplayView
Disallow /shop/ShoppingMethodsView
Disallow /shop/PromotionDisplayView
Disallow /shop/CatalogSearchResultView
Disallow /webapp/wcs/stores/servlet/BookDeliverySlotDisplayView
Disallow /webapp/wcs/stores/servlet/CheckLogon
Disallow /webapp/wcs/stores/servlet/CheckoutConfirmSubstitutionView
Disallow /servlet/CheckoutMoreDetails
Disallow /webapp/wcs/stores/servlet/CheckoutSubstitutePreference
Disallow /webapp/wcs/stores/servlet/CrossSiteRequestForgeryErrorView
Disallow /webapp/wcs/stores/servlet/DeliverySlotExpiredDisplayView
Disallow /webapp/wcs/stores/servlet/FavouritesOnOffersDisplay
Disallow /webapp/wcs/stores/servlet/MyAccount
Disallow /webapp/wcs/stores/servlet/MyAccountAddress
Disallow /webapp/wcs/stores/servlet/MyCards
Disallow /webapp/wcs/stores/servlet/MyCardsAdd
Disallow /webapp/wcs/stores/servlet/MyCouponWallet
Disallow /webapp/wcs/stores/servlet/MyDeliveryPassView
Disallow /webapp/wcs/stores/servlet/MyDetails
Disallow /webapp/wcs/stores/servlet/MyDetailsUpdate
Disallow /webapp/wcs/stores/servlet/MyFavourites
Disallow /webapp/wcs/stores/servlet/MyNectarCard
Disallow /webapp/wcs/stores/servlet/MyPreferences
Disallow /webapp/wcs/stores/servlet/MyTrolleyCheckout
Disallow /webapp/wcs/stores/servlet/OrderAmend
Disallow /webapp/wcs/stores/servlet/OrderBillingView
Disallow /webapp/wcs/stores/servlet/OrderShippingBillingConfirmationView
Disallow /webapp/wcs/stores/servlet/preLogOff
Disallow /webapp/wcs/stores/servlet/PreSendOrder
Disallow /shop/ProductFilterView
Disallow /webapp/wcs/stores/servlet/ProductFilterView
Disallow /webapp/wcs/stores/servlet/ReLogonFormView
Disallow /webapp/wcs/stores/servlet/ResetPasswordRegisterView
Disallow /webapp/wcs/stores/servlet/SelectCncLocationView
Disallow /webapp/wcs/stores/servlet/ShoppingMethodsView

Other Records

Field Value
sitemap http://www.sainsburys.co.uk/sitemap.xml

Comments

  • __PUBLIC_IP_ADDR__ - Internet facing IP Address or Domain name.