cotswoldoutdoor.com
robots.txt

Robots Exclusion Standard data for cotswoldoutdoor.com

Resource Scan

Scan Details

Site Domain cotswoldoutdoor.com
Base Domain cotswoldoutdoor.com
Scan Status Ok
Last Scan2024-05-12T15:03:39+00:00
Next Scan 2024-06-11T15:03:39+00:00

Last Scan

Scanned2024-05-12T15:03:39+00:00
URL https://cotswoldoutdoor.com/robots.txt
Redirect https://www.cotswoldoutdoor.com/robots.txt
Redirect Domain www.cotswoldoutdoor.com
Redirect Base cotswoldoutdoor.com
Domain IPs 18.238.109.50, 18.238.109.58, 18.238.109.71, 18.238.109.75
Redirect IPs 18.65.3.11, 18.65.3.121, 18.65.3.22, 18.65.3.6
Response IP 18.165.171.75
Found Yes
Hash 42a2f12d56e5c0c862c453dabc0e3e29a4d6c812e4765d63504648a45e559a85
SimHash 0a1dd2328511

Groups

*

Rule Path
Disallow /api*
Allow /api/aem/search*
Disallow /checkout*
Disallow /account*
Disallow /lister.html*
Disallow /cache/productmanual*
Disallow /content/platform-blueprints/*
Disallow /demo-pages*
Disallow /clearance/*
Disallow /errors.html
Disallow /test/*
Disallow /hosted-tokenisation.html
Disallow /fredhopper-glossary.html
Disallow /newsletter-confirmation.html
Disallow c/fillers*
Disallow /about-us/jeroen-about.html
Disallow /jeroen-flush*
Disallow /lister/no-results.html
Disallow /temporarily-unavailable.html
Disallow /Templates.html
Disallow /errors.html
Disallow /includes*
Disallow /review*
Disallow /content/experience-fragments/*
Disallow /content/dam/content-fragments/*

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cotswoldoutdoor.com/sitemap/index.xml