www.listers.mercedes-benz.co.uk
robots.txt
Robots Exclusion Standard data for www.listers.mercedes-benz.co.uk
Resource Scan
Scan Details
| Site Domain | www.listers.mercedes-benz.co.uk |
| Base Domain | mercedes-benz.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-17T14:06:46+00:00 |
| Next Scan | 2024-10-17T14:06:46+00:00 |
Last Scan
| Scanned | 2024-09-17T14:06:46+00:00 |
| URL | https://www.listers.mercedes-benz.co.uk/robots.txt |
| Domain IPs | 23.32.29.104, 23.32.29.97, 2600:1413:b000:1b::17d7:70f, 2600:1413:b000:1b::17d7:715 |
| Response IP | 23.52.40.67 |
| Found | Yes |
| Hash | c32f7bd5a0cfaf613c613724fd44f446ce1b3ace2ba698d8b303959aaf0b1960 |
| SimHash | 6009d814db53 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bin |
| Disallow | /account |
| Disallow | /apps |
| Disallow | /crx |
| Disallow | /system |
| Disallow | /libs |
| Disallow | /content |
| Allow | /content/dam/hq/brand-logo |
| Allow | /content/*/mpc/* |
| Disallow | /pab/ |
| Disallow | /sec/js/ |
| Disallow | /*.inc$ |
| Disallow | /*.wmv$ |
| Disallow | /*.cgi$ |
| Disallow | /*.xhtml$ |
| Disallow | /*.swf |
| Disallow | /*/mobile/ |
| Disallow | /*.popup.html$ |
| Disallow | /etc |
| Allow | /etc/clientlibs/acs-commons |
| Allow | /etc.clientlibs |
| Allow | /etc/designs/embxp-wholesale |
| Disallow | *content-pool |
| Allow | *content-pool/*.jpg |
| Allow | *content-pool/*.png |
| Allow | *content-pool/*.svg |
| Allow | *content-pool/*.jpeg |
| Allow | /vans/*/content-pool/apps |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.listers.mercedes-benz.co.uk/sitemaponeweb/sitemap.index.xml.gz |