sfs.ac.uk
robots.txt

Robots Exclusion Standard data for sfs.ac.uk

Resource Scan

Scan Details

Site Domain sfs.ac.uk
Base Domain sfs.ac.uk
Scan Status Ok
Last Scan2026-01-26T17:36:59+00:00
Next Scan 2026-02-02T17:36:59+00:00

Last Scan

Scanned2026-01-26T17:36:59+00:00
URL https://sfs.ac.uk/robots.txt
Redirect https://www.sfs.ac.uk/robots.txt
Redirect Domain www.sfs.ac.uk
Redirect Base sfs.ac.uk
Domain IPs 52.18.136.112
Redirect IPs 3.253.210.233
Response IP 3.253.210.233
Found Yes
Hash cd46c93fcb51531b4049240884b79b8222323014e5bb18baad25fe7d23dc7c9f
SimHash c33019323733

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sfs.ac.uk/sitemaps-2-sitemap.xml

Comments

  • robots.txt for https://www.sfs.ac.uk/
  • live - don't allow web crawlers to index cpresources/ or vendor/