derhavaneser.de
robots.txt

Robots Exclusion Standard data for derhavaneser.de

Resource Scan

Scan Details

Site Domain derhavaneser.de
Base Domain derhavaneser.de
Scan Status Ok
Last Scan2025-12-01T07:39:34+00:00
Next Scan 2025-12-08T07:39:34+00:00

Last Scan

Scanned2025-12-01T07:39:34+00:00
URL https://derhavaneser.de/robots.txt
Domain IPs 168.119.26.12, 2a01:4f8:1061:13de::2
Response IP 168.119.26.12
Found Yes
Hash 50078fbffb8a3cb4da5917bae0d72f5c77f52b74154ec208046660b7636a8e82
SimHash 083c1c50f340

Groups

ahrefsbot
backlinkcrawler
heritrix
ia_archiver
penthesilea
rogerbot
searchmetricsbot
seokicks-robot
seolytics
semrushbot
unisterbot

Rule Path
Disallow /

adsbot-google
googlebot

Rule Path
Disallow /preisvergleich/

*

Rule Path
Disallow /preisvergleich/