contrado.co.uk
robots.txt

Robots Exclusion Standard data for contrado.co.uk

Resource Scan

Scan Details

Site Domain contrado.co.uk
Base Domain contrado.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-26T19:07:47+00:00
Next Scan 2024-07-25T19:07:47+00:00

Last Successful Scan

Scanned2024-03-05T18:22:51+00:00
URL https://contrado.co.uk/robots.txt
Redirect https://www.contrado.co.uk/robots.txt
Redirect Domain www.contrado.co.uk
Redirect Base contrado.co.uk
Domain IPs 13.33.88.129, 13.33.88.35, 13.33.88.62, 13.33.88.65
Redirect IPs 13.33.88.129, 13.33.88.35, 13.33.88.62, 13.33.88.65
Response IP 13.33.88.65
Found Yes
Hash 17e0843d496f9927e8bf805d5f33d4e604511482a511f2f8d00afe2a66370a1e
SimHash 58011970ebb6

Groups

adsbot-google
adsbot-google-mobile
*

Rule Path
Disallow /store/
Disallow /estore/design/
Disallow /estore/basket
Disallow /estore/mobile/
Disallow /estore/preview/
Disallow /estore/account/
Disallow /estore/montage/
Disallow /estore/productdesign/
Disallow /estore/mvcupload/
Disallow /estore/order/
Disallow /estore/ruler/
Disallow /estore/BraintreeDropinUi/
Disallow /estore/paypal/
Disallow /estore/validation/
Disallow /estore/instagram/
Disallow /estore/clientcheckout/
Disallow /estore/PreviewHelp/
Disallow /estore/api/
Disallow /estore/contrado3d/
Disallow /contest/submit
Disallow /estore/StoresApi/GetStoreProductInfo
Allow /estore/api/price/

rogerbot

Rule Path
Disallow /ugc/
Disallow /eStore/
Disallow /blog/category/
Disallow /blog/tag/
Disallow /estore/
Disallow /gifts/
Disallow /include/
Disallow /stores/
Disallow /media/
Disallow /resources/
Disallow /faq/
Disallow /blog/author/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.contrado.co.uk/sitemap.xml
sitemap https://www.contrado.co.uk/storesitemap.xml
sitemap https://www.contrado.co.uk/storecollectionsitemap.xml