mercedes-benz.co.il
robots.txt
Robots Exclusion Standard data for mercedes-benz.co.il
Resource Scan
Scan Details
| Site Domain | mercedes-benz.co.il |
| Base Domain | mercedes-benz.co.il |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-16T20:10:26+00:00 |
| Next Scan | 2024-12-15T20:10:26+00:00 |
Last Successful Scan
| Scanned | 2023-07-31T11:15:28+00:00 |
| URL | https://mercedes-benz.co.il/robots.txt |
| Domain IPs | 13.227.254.16, 13.227.254.21, 13.227.254.3, 13.227.254.46 |
| Response IP | 108.138.17.42 |
| Found | Yes |
| Hash | 2ff9206202b1815408e5c4279ffc425f3ab14679705a2498c58cea4973f4518a |
| SimHash | d724bb8d8ef6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /category/ |
| Disallow | /magazine_post/heritage/12c1230_021/ |
| Disallow | /credit/* |
| Disallow | /line/* |
| Disallow | /smart/-/ |
| Disallow | /events/ |
| Disallow | /join_newsletter/ |
| Disallow | /search/* |
| Disallow | /engine/* |
| Disallow | /timeline/* |
| Disallow | /mercedes-inspire.pdf |
| Disallow | /feed/ |
| Disallow | *print* |
| Disallow | /?s=* |
| Disallow | /page/*/?s |
| Disallow | /?year=* |
| Disallow | /?color=* |
| Disallow | /?category=* |
| Disallow | /?model=* |
| Disallow | /?author=* |
| Disallow | /?yandex-source=* |
| Disallow | /mercedes_models_comparison/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mercedes-benz.co.il/sitemap_index.xml |
Warnings
- 3 invalid lines.