mercedes-benz.no
robots.txt
Robots Exclusion Standard data for mercedes-benz.no
Resource Scan
Scan Details
Site Domain | mercedes-benz.no |
Base Domain | mercedes-benz.no |
Scan Status | Ok |
Last Scan | 2024-10-18T04:18:04+00:00 |
Next Scan | 2024-11-17T04:18:04+00:00 |
Last Scan
Scanned | 2024-10-18T04:18:04+00:00 |
URL | https://www.mercedes-benz.no/robots.txt |
Domain IPs | 108.157.254.35, 108.157.254.45, 108.157.254.61, 108.157.254.77, 2600:9000:2753:2e00:14:e29b:2100:93a1, 2600:9000:2753:6a00:14:e29b:2100:93a1, 2600:9000:2753:7e00:14:e29b:2100:93a1, 2600:9000:2753:9e00:14:e29b:2100:93a1, 2600:9000:2753:da00:14:e29b:2100:93a1, 2600:9000:2753:ee00:14:e29b:2100:93a1, 2600:9000:2753:f400:14:e29b:2100:93a1, 2600:9000:2753:fc00:14:e29b:2100:93a1 |
Response IP | 108.157.254.45 |
Found | Yes |
Hash | 4d2d5f3d6a01a0738b9863fa5a30c3111f56932083e8b788abb9d3b7593fd707 |
SimHash | 894ddf51cd53 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */online-deposits/* |
Disallow | */site/* |
Disallow | */enquiry/* |
Disallow | */new-car-variants/* |
Disallow | */book-a-test-drive/* |
Disallow | */api/* |
Disallow | */ajax/* |
Disallow | */search/* |
Disallow | *order%3D* |
Disallow | */vehicle-search/* |
Disallow | */new-car-configurator/* |
Disallow | */data-preferences/* |
Disallow | */online-payments/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.mercedes-benz.no/sitemap.xml.gz |
sitemap | https://www.mercedes-benz.no/css-sitemap/no-no |
Comments