schaeferhunden.eu
robots.txt

Robots Exclusion Standard data for schaeferhunden.eu

Resource Scan

Scan Details

Site Domain schaeferhunden.eu
Base Domain schaeferhunden.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-27T19:07:07+00:00
Next Scan 2025-11-26T19:07:07+00:00

Last Successful Scan

Scanned2025-09-28T10:28:50+00:00
URL https://schaeferhunden.eu/robots.txt
Domain IPs 2a01:4f8:2b03:11b0::2, 46.4.208.59
Response IP 46.4.208.59
Found Yes
Hash a44bb59c8a4755627fc240b99ea2b6ce7bd41310a7ccd2452f8c4caf16f7a600
SimHash 08509b21d315

Groups

bot

Rule Path
Disallow /

spider

Rule Path
Disallow /

crawl

Rule Path
Disallow /

robot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

*

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/