Log In Sign Up

fdean.gov.uk
robots.txt

Robots Exclusion Standard data for fdean.gov.uk

Resource Scan

Scan Details

Site Domain fdean.gov.uk
Base Domain fdean.gov.uk
Scan Status Ok
Last Scan2026-01-28T14:49:37+00:00
Next Scan 2026-02-27T14:49:37+00:00

Last Scan

Scanned2026-01-28T14:49:37+00:00
URL https://fdean.gov.uk/robots.txt
Domain IPs 104.18.16.166, 104.18.17.166, 2606:4700::6812:10a6, 2606:4700::6812:11a6
Response IP 104.18.16.166
Found Yes
Hash bac790fe1ef1b3356f1f21bf31b339e63890be6f1d897d6e2aaa64527486ea77
SimHash 94589b76d5f0

Groups

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com

Rule Path
Allow /

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com

Rule Path
Allow /

googlebot

Rule Path
Disallow /
Back to top

Comments

  • SiteImprove should ignore these page particularly because they aren't actually used, but are still linked for historical reasons
Back to top