retailgroup.co.uk
robots.txt
Robots Exclusion Standard data for retailgroup.co.uk
Resource Scan
Scan Details
| Site Domain | retailgroup.co.uk |
| Base Domain | retailgroup.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-03T00:35:50+00:00 |
| Next Scan | 2024-10-03T00:35:50+00:00 |
Last Scan
| Scanned | 2024-09-03T00:35:50+00:00 |
| URL | https://www.retailgroup.co.uk/robots.txt |
| Domain IPs | 13.35.18.121, 13.35.18.40, 13.35.18.41, 13.35.18.73, 2600:9000:20c7:2200:b:ca12:be40:93a1, 2600:9000:20c7:3400:b:ca12:be40:93a1, 2600:9000:20c7:3800:b:ca12:be40:93a1, 2600:9000:20c7:7400:b:ca12:be40:93a1, 2600:9000:20c7:c000:b:ca12:be40:93a1, 2600:9000:20c7:ea00:b:ca12:be40:93a1, 2600:9000:20c7:ec00:b:ca12:be40:93a1, 2600:9000:20c7:f400:b:ca12:be40:93a1 |
| Response IP | 13.35.18.73 |
| Found | Yes |
| Hash | ec2c470736857e1f58b1a0b246b62f54b4f19aceb05f35ef53b5076f1060e7fc |
| SimHash | 8b0dda01edc3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */online-deposits/* |
| Disallow | */site/* |
| Disallow | */enquiry/* |
| Disallow | */new-car-variants/* |
| Disallow | */book-a-test-drive/* |
| Disallow | */api/* |
| Disallow | */ajax/* |
| Disallow | */search/* |
| Disallow | *order%3D* |
| Disallow | */vehicle-search/* |
| Disallow | */new-car-configurator/* |
| Disallow | */data-preferences/* |
| Disallow | */online-payments/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.retailgroup.co.uk/sitemap.xml.gz |
Comments