mercedes-benz.com
robots.txt
Robots Exclusion Standard data for mercedes-benz.com
Resource Scan
Scan Details
Site Domain | mercedes-benz.com |
Base Domain | mercedes-benz.com |
Scan Status | Ok |
Last Scan | 2024-11-07T21:46:10+00:00 |
Next Scan | 2024-11-21T21:46:10+00:00 |
Last Scan
Scanned | 2024-11-07T21:46:10+00:00 |
URL | https://mercedes-benz.com/robots.txt |
Redirect | https://www.mercedes-benz.com/robots.txt |
Redirect Domain | www.mercedes-benz.com |
Redirect Base | mercedes-benz.com |
Domain IPs | 18.185.250.44 |
Redirect IPs | 184.50.85.140, 2600:1413:1::6011:b42b, 2600:1413:1::6011:b42c, 96.17.180.186 |
Response IP | 23.215.7.26 |
Found | Yes |
Hash | 11877729c7956414d5ad76e096a2f94b18a941f6123cf1a3d03397b28a409d2a |
SimHash | 6500d855c535 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin/ |
Disallow | /apps/ |
Disallow | /crx/ |
Disallow | /system/ |
Disallow | /libs/ |
Disallow | /content/ |
Allow | /content/dam/ |
Allow | /content/com/ |
Disallow | /etc/ |
Disallow | /etc.clientlibs/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.mercedes-benz.com/content/com/de.sitemap.xml |
sitemap | https://www.mercedes-benz.com/content/com/en.sitemap.xml |
Warnings
- `host` is not a known field.