telford.gov.uk
robots.txt
Robots Exclusion Standard data for telford.gov.uk
Resource Scan
Scan Details
Site Domain | telford.gov.uk |
Base Domain | telford.gov.uk |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-23T01:01:12+00:00 |
Next Scan | 2024-12-22T01:01:12+00:00 |
Last Successful Scan
Scanned | 2023-05-04T17:34:26+00:00 |
URL | https://telford.gov.uk/robots.txt |
Redirect | https://www.telford.gov.uk/robots.txt |
Redirect Domain | www.telford.gov.uk |
Redirect Base | telford.gov.uk |
Domain IPs | 92.42.56.150 |
Redirect IPs | 92.42.56.150 |
Response IP | 92.42.56.150 |
Found | Yes |
Hash | c5d1937011c214c088661f394458a1b2aadead4a15c763962231a29e36acba7c |
SimHash | 8c3599226710 |
Groups
*
Rule | Path |
---|---|
Disallow | /images |
Disallow | /javascript |
Disallow | /jadu |
Disallow | /blogAdmin |
Disallow | /preview |
Disallow | /search |
Disallow | /site/scripts/google_results.php |
Disallow | /site_search/* |