meintierdiscount.de
robots.txt

Robots Exclusion Standard data for meintierdiscount.de

Resource Scan

Scan Details

Site Domain meintierdiscount.de
Base Domain meintierdiscount.de
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-15T17:21:46+00:00
Next Scan 2024-10-13T17:21:46+00:00

Last Successful Scan

Scanned2024-02-22T17:35:14+00:00
URL https://meintierdiscount.de/robots.txt
Redirect https://www.meintierdiscount.de/robots.txt
Redirect Domain www.meintierdiscount.de
Redirect Base meintierdiscount.de
Domain IPs 157.90.212.106
Redirect IPs 157.90.212.106
Response IP 157.90.212.106
Found Yes
Hash 8d702175cd4ad9c41cacad47f524ca33f4e863eadde537c810f2656e3719afb0
SimHash 4808caa04970

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

yandex

Rule Path
Disallow /

lcc

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /*crawl%3Dno
Disallow /rss/*

slurp

Rule Path
Disallow /media/