diabsite.de
robots.txt

Robots Exclusion Standard data for diabsite.de

Resource Scan

Scan Details

Site Domain diabsite.de
Base Domain diabsite.de
Scan Status Ok
Last Scan2025-04-17T11:01:49+00:00
Next Scan 2025-05-17T11:01:49+00:00

Last Scan

Scanned2025-04-17T11:01:49+00:00
URL https://diabsite.de/robots.txt
Domain IPs 2a00:1169:103:1d70::, 92.205.54.23
Response IP 92.205.54.23
Found Yes
Hash fd585c9746e5cee012bc735389813713b9f9436f5c12519d57ec1feca7724367
SimHash 8a4cc8a4e136

Groups

*

Rule Path
Disallow /admin
Disallow /bin
Disallow /cgi-bin
Disallow /etc
Disallow /lib32
Disallow /logs
Disallow /stats
Disallow /testbereich

emailcollector

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

teleport*

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webdevil

Rule Path
Disallow /

webzip

Rule Path
Disallow /

net attache

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

wx_mail/2.000

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

whowhere

Rule Path
Disallow /

roverbot

Rule Path
Disallow /

activeagent

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

mirago

Rule Path
Disallow /

yandex

Rule Path
Disallow /index

bingbot

Rule Path
Disallow /index