crocus.co.uk
robots.txt

Robots Exclusion Standard data for crocus.co.uk

Resource Scan

Scan Details

Site Domain crocus.co.uk
Base Domain crocus.co.uk
Scan Status Ok
Last Scan2025-10-15T19:43:16+00:00
Next Scan 2025-11-14T19:43:16+00:00

Last Scan

Scanned2025-10-15T19:43:16+00:00
URL https://crocus.co.uk/robots.txt
Redirect https://www.crocus.co.uk/robots.txt
Redirect Domain www.crocus.co.uk
Redirect Base crocus.co.uk
Domain IPs 23.212.249.137, 23.212.249.144
Redirect IPs 23.45.207.71, 23.45.207.88, 2600:1413:5000:12::1737:27e6, 2600:1413:5000:12::1737:27e8
Response IP 23.61.202.111
Found Yes
Hash 2c02077f02756f5c30c19c98d8121ca49d75799ec590a1ed1bb677055b2adc2a
SimHash 3551c002d8d0

Groups

*

Rule Path
Disallow /wheelbarrow/
Disallow /myaccount/
Disallow /myorders/
Disallow /mywishlist/
Disallow /myaddressbook/
Disallow /myaccountoptions/
Disallow /myreminders/
Disallow /html/3dsecure/
Disallow /html/miniwheelbarrow/
Disallow /next-orders/

Other Records

Field Value
sitemap https://sdlsecure2.co.uk/sitemaps/crocus/page_sitemap.xml
sitemap https://sdlsecure2.co.uk/sitemaps/crocus/image_sitemap.xml