s1.co.uk
robots.txt

Robots Exclusion Standard data for s1.co.uk

Resource Scan

Scan Details

Site Domain s1.co.uk
Base Domain s1.co.uk
Scan Status Ok
Last Scan2025-08-19T06:59:27+00:00
Next Scan 2025-08-26T06:59:27+00:00

Last Scan

Scanned2025-08-19T06:59:27+00:00
URL https://s1.co.uk/robots.txt
Redirect https://www.storefirst.com/robots.txt
Redirect Domain www.storefirst.com
Redirect Base storefirst.com
Domain IPs 178.238.139.208
Redirect IPs 52.84.45.109, 52.84.45.72, 52.84.45.90, 52.84.45.94
Response IP 18.244.87.9
Found Yes
Hash 213473d3e012083805ae05ca03bb50da6b3fd5bbf51023d22beffd578f2c10c4
SimHash 0070892137b5

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /?
Disallow /admin
Disallow /locations/self-storage-barnsley/?
Disallow /locations/self-storage-blackburn/?
Disallow /locations/self-storage-burnley/?
Disallow /locations/self-storage-derby/?
Disallow /locations/self-storage-ellesmere-port/?
Disallow /locations/self-storage-glasgow/?
Disallow /locations/self-storage-leeds/?
Disallow /locations/self-storage-liverpool/?
Disallow /locations/self-storage-manchester/?
Disallow /locations/self-storage-mansfield/?
Disallow /locations/self-storage-northampton/?
Disallow /locations/self-storage-preston/?
Disallow /locations/self-storage-rochdale/?
Disallow /locations/self-storage-st-helens/?
Disallow /locations/self-storage-wakefield/?
Disallow /price/calculator?
Disallow /price?
Disallow /storage-news?

Other Records

Field Value
sitemap https://www.storefirst.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.storefirst.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/