allenmotorgroup.co.uk
robots.txt
Robots Exclusion Standard data for allenmotorgroup.co.uk
Resource Scan
Scan Details
| Site Domain | allenmotorgroup.co.uk |
| Base Domain | allenmotorgroup.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-10T12:36:08+00:00 |
| Next Scan | 2024-11-09T12:36:08+00:00 |
Last Scan
| Scanned | 2024-10-10T12:36:08+00:00 |
| URL | https://www.allenmotorgroup.co.uk/robots.txt |
| Domain IPs | 108.157.254.12, 108.157.254.126, 108.157.254.52, 108.157.254.92, 2600:9000:2753:1c00:12:1567:c640:93a1, 2600:9000:2753:1e00:12:1567:c640:93a1, 2600:9000:2753:4200:12:1567:c640:93a1, 2600:9000:2753:600:12:1567:c640:93a1, 2600:9000:2753:9e00:12:1567:c640:93a1, 2600:9000:2753:d400:12:1567:c640:93a1, 2600:9000:2753:d800:12:1567:c640:93a1, 2600:9000:2753:f200:12:1567:c640:93a1 |
| Response IP | 108.157.254.52 |
| Found | Yes |
| Hash | acfaccff0cd1fd10651b27be37f9a361164db12bad2eafe618f18c55569d5041 |
| SimHash | 890dde41edc2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */online-deposits/* |
| Disallow | */site/* |
| Disallow | */enquiry/* |
| Disallow | */new-car-variants/* |
| Disallow | */book-a-test-drive/* |
| Disallow | */api/* |
| Disallow | */ajax/* |
| Disallow | */search/* |
| Disallow | *order%3D* |
| Disallow | */vehicle-search/* |
| Disallow | */new-car-configurator/* |
| Disallow | */data-preferences/* |
| Disallow | */online-payments/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.allenmotorgroup.co.uk/sitemap.xml.gz |
Comments