mercedes-benz.be
robots.txt
Robots Exclusion Standard data for mercedes-benz.be
Resource Scan
Scan Details
Site Domain | mercedes-benz.be |
Base Domain | mercedes-benz.be |
Scan Status | Ok |
Last Scan | 2024-06-23T10:12:11+00:00 |
Next Scan | 2024-07-23T10:12:11+00:00 |
Last Scan
Scanned | 2024-06-23T10:12:11+00:00 |
URL | https://www.mercedes-benz.be/robots.txt |
Domain IPs | 23.59.168.162, 23.59.168.168, 2600:1413:1::6011:b42b, 2600:1413:1::6011:b42c |
Response IP | 23.59.168.162 |
Found | Yes |
Hash | 78ecfe51449cbfa804af0d9b8968c7ec919ff817b1bda6abca1c3151bbf2c85e |
SimHash | 610d58065b53 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin |
Disallow | /account |
Disallow | /apps |
Disallow | /crx |
Disallow | /system |
Disallow | /libs |
Disallow | /content |
Allow | /content/dam/hq/brand-logo |
Allow | /passengercars/content-pool/tool-pages/car-configurator* |
Allow | /content/*/mpc/* |
Disallow | /pab/ |
Disallow | /sec/js/ |
Disallow | /*.inc$ |
Disallow | /*.wmv$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.swf |
Disallow | /*/mobile/ |
Disallow | /*.popup.html$ |
Disallow | /etc |
Allow | /etc/clientlibs/acs-commons |
Allow | /etc.clientlibs |
Allow | /etc/designs/embxp-wholesale |
Disallow | *content-pool |
Allow | *content-pool/*.jpg |
Allow | *content-pool/*.png |
Allow | *content-pool/*.svg |
Allow | *content-pool/*.jpeg |
Allow | /vans/*/content-pool/apps |
Allow | /vans/*/content-pool/contactmodule-form |
Allow | /vans/*/content-pool/tools/legal |
Allow | /vans/*/content-pool/forms |
Allow | /content/*.jpg |
Allow | /content/*.png |
Allow | /content/*.svg |
Allow | /content/*.jpeg |
Allow | /content/*.mp4 |
Allow | /content/*.webm |
Allow | /content/*.ogv |
Allow | /content/*.vtt |
Allow | /content/*.gif |
Allow | /content/*.ico |
Allow | /content/*.svgz |
Other Records
Field | Value |
---|---|
sitemap | https://www.mercedes-benz.be/sitemaponeweb/sitemap.index.xml.gz |
sitemap | https://www.mercedes-benz.be/vans/sitemaponeweb.sitemap.index.xml.gz |
sitemap | https://www.mercedes-benz.be/passengercars/customer-service/sitemap/fr_BE |
sitemap | https://www.mercedes-benz.be/passengercars/customer-service/sitemap/nl_BE |