truckanddriver.co.uk
robots.txt
Robots Exclusion Standard data for truckanddriver.co.uk
Resource Scan
Scan Details
| Site Domain | truckanddriver.co.uk |
| Base Domain | truckanddriver.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-01T09:41:36+00:00 |
| Next Scan | 2024-11-08T09:41:36+00:00 |
Last Scan
| Scanned | 2024-11-01T09:41:36+00:00 |
| URL | https://truckanddriver.co.uk/robots.txt |
| Domain IPs | 104.21.53.107, 172.67.212.5, 2606:4700:3032::6815:356b, 2606:4700:3037::ac43:d405 |
| Response IP | 172.67.212.5 |
| Found | Yes |
| Hash | 2f46d14a5d75070056b521df8b6fababfed5a820e9b3c69b6449194ed91aa616 |
| SimHash | 65250641d91a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sign-out |
| Disallow | /sign-in |
| Disallow | /forgotten-password |
| Disallow | /my-account/* |
| Disallow | /my-account |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.truckanddriver.co.uk/sitemap_index.xml |