schweriner-see.de
robots.txt

Robots Exclusion Standard data for schweriner-see.de

Resource Scan

Scan Details

Site Domain schweriner-see.de
Base Domain schweriner-see.de
Scan Status Ok
Last Scan2024-11-15T20:41:58+00:00
Next Scan 2024-12-15T20:41:58+00:00

Last Scan

Scanned2024-11-15T20:41:58+00:00
URL https://schweriner-see.de/robots.txt
Redirect https://www.schweriner-see.de/robots.txt
Redirect Domain www.schweriner-see.de
Redirect Base schweriner-see.de
Domain IPs 46.163.112.174
Redirect IPs 46.163.112.174
Response IP 46.163.112.174
Found Yes
Hash a8775dd0baa64ceb7299069d4059317902f46471c59550a2020e3b937d42eb00
SimHash b97445aac542

Groups

updownerbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

eurobot

Rule Path
Disallow /

trovit

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

ventro

Rule Path
Disallow /

spbot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

xenu

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

terranautic

Rule Path
Disallow /

envolk

Rule Path
Disallow /

vebidoo

Rule Path
Disallow /