salford.gov.uk
robots.txt
Robots Exclusion Standard data for salford.gov.uk
Resource Scan
Scan Details
| Site Domain | salford.gov.uk |
| Base Domain | salford.gov.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-05T21:18:49+00:00 |
| Next Scan | 2024-10-05T21:18:49+00:00 |
Last Scan
| Scanned | 2024-09-05T21:18:49+00:00 |
| URL | https://www.salford.gov.uk/robots.txt |
| Domain IPs | 86.12.129.71 |
| Response IP | 86.12.129.71 |
| Found | Yes |
| Hash | e63c77c26a5a250d0f99524cf791b131817c65293ecbdd92d7f764a901e6a1f4 |
| SimHash | b1027b0d4ff0 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /aspnet_client/ | - |
| Disallow | /bin/ | - |
| Disallow | /config/ | - |
| Disallow | /css/ | - |
| Disallow | /data/ | - |
| Disallow | /install/ | - |
| Disallow | /masterpages/ | - |
| Disallow | /python/ | - |
| Disallow | /scripts/ | - |
| Disallow | /umbraco/ | - |
| Disallow | /umbraco_client/ | - |
| Disallow | /usercontrols/ | - |
| Disallow | /xslt/ | - |
| Disallow | /media/ | - |
| Disallow | /search?* | Old search page No longer valid but still being seen on google results (searchengineland.com/a-deeper-look-at-robotstxt-17573) |
Comments