autoteile24.de
robots.txt

Robots Exclusion Standard data for autoteile24.de

Resource Scan

Scan Details

Site Domain autoteile24.de
Base Domain autoteile24.de
Scan Status Ok
Last Scan2024-05-21T08:59:37+00:00
Next Scan 2024-06-20T08:59:37+00:00

Last Scan

Scanned2024-05-21T08:59:37+00:00
URL https://autoteile24.de/robots.txt
Redirect https://www.autoteile24.de/robots.txt
Redirect Domain www.autoteile24.de
Redirect Base autoteile24.de
Domain IPs 18.154.132.118, 18.154.132.52, 18.154.132.64, 18.154.132.79
Redirect IPs 18.154.132.118, 18.154.132.52, 18.154.132.64, 18.154.132.79
Response IP 108.157.52.27
Found Yes
Hash fcd6585a23279fb93f061f2eba4450ba3b0139438cc354d5df024bbb9c525d9b
SimHash c95419f2d755

Groups

*

Rule Path
Disallow /customer/*
Disallow /shop/*
Disallow /catalog/*
Disallow /car/ajax/manufacturers
Disallow /search/ajax/product
Disallow /*?page=
Disallow /*sort_order%3D
Disallow /*sort%3D
Allow /customer/login
Allow /*?prc=*
Allow /*?icid=*

googlebot

Rule Path
Disallow /customer/*
Disallow /shop/*
Disallow /catalog/*
Disallow /car/ajax/manufacturers
Disallow /search/ajax/product
Disallow /*?page=
Disallow /*sort_order%3D
Disallow /*sort%3D
Allow /customer/login
Allow /*?prc=*
Allow /*?icid=*

googlebot-image
adsbot-google-mobile
adsbot-google
mediapartners-google

Rule Path
Disallow

gptbot

Rule Path
Disallow /