defra.gov.uk
robots.txt
Robots Exclusion Standard data for defra.gov.uk
Resource Scan
Scan Details
| Site Domain | defra.gov.uk |
| Base Domain | defra.gov.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-25T00:58:08+00:00 |
| Next Scan | 2024-10-25T00:58:08+00:00 |
Last Scan
| Scanned | 2024-09-25T00:58:08+00:00 |
| URL | http://defra.gov.uk/robots.txt |
| Domain IPs | 151.101.0.144, 151.101.128.144, 151.101.192.144, 151.101.64.144 |
| Response IP | 151.101.192.144 |
| Found | Yes |
| Hash | f9b07ad40f88fc1f67d14987e40751b00e0eb4fa7eb7910a26d41e38f3ae3c35 |
| SimHash | 680cc8448d93 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://defra.gov.uk/sitemap.xml |