autoteile24.de
robots.txt
Robots Exclusion Standard data for autoteile24.de
Resource Scan
Scan Details
Site Domain | autoteile24.de |
Base Domain | autoteile24.de |
Scan Status | Ok |
Last Scan | 2024-05-21T08:59:37+00:00 |
Next Scan | 2024-06-20T08:59:37+00:00 |
Last Scan
Scanned | 2024-05-21T08:59:37+00:00 |
URL | https://autoteile24.de/robots.txt |
Redirect | https://www.autoteile24.de/robots.txt |
Redirect Domain | www.autoteile24.de |
Redirect Base | autoteile24.de |
Domain IPs | 18.154.132.118, 18.154.132.52, 18.154.132.64, 18.154.132.79 |
Redirect IPs | 18.154.132.118, 18.154.132.52, 18.154.132.64, 18.154.132.79 |
Response IP | 108.157.52.27 |
Found | Yes |
Hash | fcd6585a23279fb93f061f2eba4450ba3b0139438cc354d5df024bbb9c525d9b |
SimHash | c95419f2d755 |
Groups
*
Rule | Path |
---|---|
Disallow | /customer/* |
Disallow | /shop/* |
Disallow | /catalog/* |
Disallow | /car/ajax/manufacturers |
Disallow | /search/ajax/product |
Disallow | /*?page= |
Disallow | /*sort_order%3D |
Disallow | /*sort%3D |
Allow | /customer/login |
Allow | /*?prc=* |
Allow | /*?icid=* |