dorsetcouncil.gov.uk
robots.txt
Robots Exclusion Standard data for dorsetcouncil.gov.uk
Resource Scan
Scan Details
Site Domain | dorsetcouncil.gov.uk |
Base Domain | dorsetcouncil.gov.uk |
Scan Status | Ok |
Last Scan | 2024-06-30T22:33:21+00:00 |
Next Scan | 2024-07-30T22:33:21+00:00 |
Last Scan
Scanned | 2024-06-30T22:33:21+00:00 |
URL | https://dorsetcouncil.gov.uk/robots.txt |
Redirect | https://www.dorsetcouncil.gov.uk/robots.txt |
Redirect Domain | www.dorsetcouncil.gov.uk |
Redirect Base | dorsetcouncil.gov.uk |
Domain IPs | 18.170.182.22 |
Redirect IPs | 13.40.38.112, 13.42.71.235 |
Response IP | 13.42.71.235 |
Found | Yes |
Hash | c0ae7c2b22a5e05a6c1e535f3a639cb56f5341d549f2bca247a87ff1c22abcd8 |
SimHash | bd18bb804f13 |
Groups
*
Rule | Path |
---|---|
Disallow | /web/guest/w/coastal-access-in-dorset |
Disallow | /documents/35024/4052151/ |
Disallow | /w/thank-you-send-survey |
Disallow | /w/safeguarding-portal |
Disallow | /care-and-support-for-adults/adult-abuse/safeguarding-portal |
Disallow | /w/summer-holiday-activities |