www.vertu.mercedes-benz.co.uk
robots.txt
Robots Exclusion Standard data for www.vertu.mercedes-benz.co.uk
Resource Scan
Scan Details
Site Domain | www.vertu.mercedes-benz.co.uk |
Base Domain | mercedes-benz.co.uk |
Scan Status | Ok |
Last Scan | 2024-10-18T23:06:26+00:00 |
Next Scan | 2024-11-17T23:06:26+00:00 |
Last Scan
Scanned | 2024-10-18T23:06:26+00:00 |
URL | https://www.vertu.mercedes-benz.co.uk/robots.txt |
Domain IPs | 23.215.7.15, 23.215.7.21, 2600:1413:b000:1b::17d7:70f, 2600:1413:b000:1b::17d7:715 |
Response IP | 184.50.85.131 |
Found | Yes |
Hash | e9674eb01aeda683f52de0d24e1103a94d8947dab85629233e33550456e17d22 |
SimHash | 6009d810d7d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin |
Disallow | /account |
Disallow | /apps |
Disallow | /crx |
Disallow | /system |
Disallow | /libs |
Disallow | /content |
Allow | /content/dam/hq/brand-logo |
Allow | /content/*/mpc/* |
Disallow | /pab/ |
Disallow | /sec/js/ |
Disallow | /*.inc$ |
Disallow | /*.wmv$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.swf |
Disallow | /*/mobile/ |
Disallow | /*.popup.html$ |
Disallow | /etc |
Allow | /etc/clientlibs/acs-commons |
Allow | /etc.clientlibs |
Allow | /etc/designs/embxp-wholesale |
Disallow | *content-pool |
Allow | *content-pool/*.jpg |
Allow | *content-pool/*.png |
Allow | *content-pool/*.svg |
Allow | *content-pool/*.jpeg |
Allow | /vans/*/content-pool/apps |
Other Records
Field | Value |
---|---|
sitemap | https://www.vertu.mercedes-benz.co.uk/sitemaponeweb/sitemap.index.xml.gz |