allenmotorgroup.co.uk
robots.txt
Robots Exclusion Standard data for allenmotorgroup.co.uk
Resource Scan
Scan Details
| Site Domain | allenmotorgroup.co.uk |
| Base Domain | allenmotorgroup.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-10T12:36:07+00:00 |
| Next Scan | 2024-10-10T12:36:07+00:00 |
Last Scan
| Scanned | 2024-09-10T12:36:07+00:00 |
| URL | https://www.allenmotorgroup.co.uk/robots.txt |
| Domain IPs | 13.226.61.24, 13.226.61.26, 13.226.61.66, 13.226.61.67, 2600:9000:2753:0:12:1567:c640:93a1, 2600:9000:2753:5600:12:1567:c640:93a1, 2600:9000:2753:6600:12:1567:c640:93a1, 2600:9000:2753:6800:12:1567:c640:93a1, 2600:9000:2753:aa00:12:1567:c640:93a1, 2600:9000:2753:c200:12:1567:c640:93a1, 2600:9000:2753:c600:12:1567:c640:93a1, 2600:9000:2753:de00:12:1567:c640:93a1 |
| Response IP | 108.157.254.126 |
| Found | Yes |
| Hash | acfaccff0cd1fd10651b27be37f9a361164db12bad2eafe618f18c55569d5041 |
| SimHash | 890dde41edc2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */online-deposits/* |
| Disallow | */site/* |
| Disallow | */enquiry/* |
| Disallow | */new-car-variants/* |
| Disallow | */book-a-test-drive/* |
| Disallow | */api/* |
| Disallow | */ajax/* |
| Disallow | */search/* |
| Disallow | *order%3D* |
| Disallow | */vehicle-search/* |
| Disallow | */new-car-configurator/* |
| Disallow | */data-preferences/* |
| Disallow | */online-payments/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.allenmotorgroup.co.uk/sitemap.xml.gz |
Comments