mercedes-benz.is
robots.txt
Robots Exclusion Standard data for mercedes-benz.is
Resource Scan
Scan Details
Site Domain | mercedes-benz.is |
Base Domain | mercedes-benz.is |
Scan Status | Ok |
Last Scan | 2024-09-04T19:59:46+00:00 |
Next Scan | 2024-10-04T19:59:46+00:00 |
Last Scan
Scanned | 2024-09-04T19:59:46+00:00 |
URL | https://www.mercedes-benz.is/robots.txt |
Domain IPs | 13.33.88.13, 13.33.88.52, 13.33.88.6, 13.33.88.89, 2600:9000:223b:2000:1c:fab8:cd00:93a1, 2600:9000:223b:200:1c:fab8:cd00:93a1, 2600:9000:223b:3800:1c:fab8:cd00:93a1, 2600:9000:223b:4800:1c:fab8:cd00:93a1, 2600:9000:223b:6200:1c:fab8:cd00:93a1, 2600:9000:223b:7c00:1c:fab8:cd00:93a1, 2600:9000:223b:9c00:1c:fab8:cd00:93a1, 2600:9000:223b:fe00:1c:fab8:cd00:93a1 |
Response IP | 13.33.88.6 |
Found | Yes |
Hash | 648e70234c3b4d9ecfff416df4a4581d411f2e37c257776dda2b6ecb767807c9 |
SimHash | 831dda01ed43 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */online-deposits/* |
Disallow | */site/* |
Disallow | */enquiry/* |
Disallow | */new-car-variants/* |
Disallow | */book-a-test-drive/* |
Disallow | */api/* |
Disallow | */ajax/* |
Disallow | */search/* |
Disallow | *order%3D* |
Disallow | */vehicle-search/* |
Disallow | */new-car-configurator/* |
Disallow | */data-preferences/* |
Disallow | */online-payments/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.mercedes-benz.is/sitemap.xml.gz |
sitemap | https://www.mercedes-benz.is/css-sitemap/en-is |
Comments