benz.fr
robots.txt
Robots Exclusion Standard data for benz.fr
Resource Scan
Scan Details
| Site Domain | benz.fr |
| Base Domain | benz.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-17T03:41:03+00:00 |
| Next Scan | 2024-12-16T03:41:03+00:00 |
Last Successful Scan
| Scanned | 2024-05-09T08:41:29+00:00 |
| URL | https://www.benz.fr/robots.txt |
| Domain IPs | 23.215.7.28, 23.215.7.29, 2600:1413:b000:1b::17d7:71c, 2600:1413:b000:1b::17d7:71d |
| Response IP | 23.52.171.225 |
| Found | Yes |
| Hash | 45cb595e8c72a5a400075be10dcc0de1d0bb8b138d68f2289ec689a37bbdc51d |
| SimHash | 600058165b55 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bin |
| Disallow | /account |
| Disallow | /apps |
| Disallow | /crx |
| Disallow | /system |
| Disallow | /libs |
| Disallow | /content |
| Disallow | /vans/*/list-reference* |
| Disallow | /vans/*/model-carousel* |
| Disallow | /vans/*/hotspot* |
| Disallow | /vans/*/teaser-group* |
| Disallow | /vans/*/packs-techno* |
| Disallow | /vans/buy/used-vans.html/details/* |
| Disallow | /vans/buy/used-vans.html/search/* |
| Allow | /content/dam/hq/brand-logo |
| Allow | /passengercars/content-pool/tool-pages/car-configurator* |
| Allow | /content/*/mpc/* |
| Disallow | /pab/ |
| Disallow | /sec/js/ |
| Disallow | /*.inc$ |
| Disallow | /*.wmv$ |
| Disallow | /*.cgi$ |
| Disallow | /*.xhtml$ |
| Disallow | /*.swf |
| Disallow | /*/mobile/ |
| Disallow | /*.popup.html$ |
| Disallow | /etc |
| Allow | /etc/clientlibs/acs-commons |
| Allow | /etc.clientlibs |
| Allow | /etc/designs/embxp-wholesale |
| Disallow | *content-pool |
| Allow | *content-pool/*.jpg |
| Allow | *content-pool/*.png |
| Allow | *content-pool/*.svg |
| Allow | *content-pool/*.jpeg |
| Allow | /vans/*/content-pool/apps |
| Allow | /vans/*/content-pool/tools/legal |
| Allow | /vans/*/content-pool/forms |
| Allow | /content/*.jpg |
| Allow | /content/*.png |
| Allow | /content/*.svg |
| Allow | /content/*.jpeg |
| Allow | /content/*.mp4 |
| Allow | /content/*.webm |
| Allow | /content/*.ogv |
| Allow | /content/*.vtt |
| Allow | /content/*.gif |
| Allow | /content/*.ico |
| Allow | /content/*.svgz |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mercedes-benz.fr/sitemaponeweb/sitemap.index.xml.gz |
| sitemap | https://www.mercedes-benz.fr/passengercars/customer-service/sitemap/fr_FR |
| sitemap | https://www.mercedes-benz.fr/vans/sitemaps/vvs-vss/fr.sitemap.vanstocksearch.xml |