drogeriedepot.de
robots.txt

Robots Exclusion Standard data for drogeriedepot.de

Resource Scan

Scan Details

Site Domain drogeriedepot.de
Base Domain drogeriedepot.de
Scan Status Ok
Last Scan2024-06-13T16:16:54+00:00
Next Scan 2024-07-13T16:16:54+00:00

Last Scan

Scanned2024-06-13T16:16:54+00:00
URL https://drogeriedepot.de/robots.txt
Redirect https://www.drogeriedepot.de/robots.txt
Redirect Domain www.drogeriedepot.de
Redirect Base drogeriedepot.de
Domain IPs 212.83.50.146
Redirect IPs 212.83.50.146
Response IP 212.83.50.146
Found Yes
Hash ee28d266bc6dca157a6b6e11f864607b2eed98ee19cf796a3aeb5d94536aefc9
SimHash 9078c2506e31

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

ccdunhams

Rule Path
Disallow /

spark

Rule Path
Disallow /
Disallow /*?dir=*
Disallow /*?order=*
Disallow /*?p=*
Disallow /*%26dir%3D*
Disallow /*%26order%3D*
Disallow /*%26p%3D*

*

Rule Path
Disallow /feeds/
Disallow /ext/
Disallow /tmp/

ia_archiver disallow: /

Rule Path
Allow