Log In Sign Up

kroschke.com
robots.txt

Robots Exclusion Standard data for kroschke.com

Resource Scan

Scan Details

Site Domain kroschke.com
Base Domain kroschke.com
Scan Status Ok
Last Scan2024-06-24T00:45:38+00:00
Next Scan 2024-07-24T00:45:38+00:00

Last Scan

Scanned2024-06-24T00:45:38+00:00
URL https://kroschke.com/robots.txt
Redirect https://www.kroschke.com/robots.txt
Redirect Domain www.kroschke.com
Redirect Base kroschke.com
Domain IPs 104.16.91.37, 104.16.92.37, 2606:4700::6810:5b25, 2606:4700::6810:5c25
Redirect IPs 104.16.91.37, 104.16.92.37, 2606:4700::6810:5b25, 2606:4700::6810:5c25
Response IP 104.16.92.37
Found Yes
Hash 6261cd11c822bc519ea5e144d37acdac3224aff649bef244bc99a7903cd22152
SimHash 629a16ea4da1

Groups

*

Rule Path
Disallow /store/default/de/material/recommend/
Disallow /store/default/de/material/request/
Disallow /store/default/de/doknr/plain/
Disallow /store/default/de/affiliate/
Disallow /store/default/de/mobile
Disallow /store/default/de/xmlrpc/
Disallow /store/default/de/navigation/byarea/
Disallow /store/default/de/navigation/details/
Disallow /store/default/de/search/
Disallow /store/default/de/account/
Disallow /store/default/de/basket/
Disallow /store/default/de/leaflet/
Disallow /store/default/de/captcha/
Disallow /store/default/de/tag/
Disallow /store/default/de/landing/
Disallow /static/pdf-kroschke/2010/
Disallow */load?list=
Disallow /siblings/

grub-client

Rule Path
Disallow /

grub

Rule Path
Disallow /

looksmart

Rule Path
Disallow /

webzip

Rule Path
Disallow /

b2w/0.1

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

crescent

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

ia_archiver/1.6

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

website quester

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

webauto

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

rma

Rule Path
Disallow /

libweb/clshttp

Rule Path
Disallow /

asterias

Rule Path
Disallow /

httplib

Rule Path
Disallow /

turingos

Rule Path
Disallow /

spanner

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

bullseye/1.0

Rule Path
Disallow /

mozilla/4.0 (compatible; bullseye; windows 95)

Rule Path
Disallow /

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /

cherrypickerse/1.0

Rule Path
Disallow /

cherrypickerelite/1.0

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

microsoft url control - 5.01.4511

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

foobot

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

botalot

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

microsoft url control - 6.00.8169

Rule Path
Disallow /

urly warning

Rule Path
Disallow /

wget/1.6

Rule Path
Disallow /

wget/1.5.3

Rule Path
Disallow /

wget

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

moget

Rule Path
Disallow /

hloader

Rule Path
Disallow /

humanlinks

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

blowfish/1.0

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

miixpc/4.2

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

propowerbot/2.14

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

tocrawl/urldispatcher

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

vci webviewer vci webviewer win32

Rule Path
Disallow /

vci

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

queryn metasearch

Rule Path
Disallow /

openfind data gathere

Rule Path
Disallow /

openfind

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

repomonkey bait & tackle/v1.01

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

openbot

Rule Path
Disallow /

url control

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

kenjin spider

Rule Path
Disallow /

iron33/1.0.2

Rule Path
Disallow /

bookmark search tool

Rule Path
Disallow /

getright/4.2

Rule Path
Disallow /

fairad client

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

aqua_products

Rule Path
Disallow /

radiation retriever 1.1

Rule Path
Disallow /

flaming attackbot

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

perman

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

sp_auditbot
seobility
seznambot
cliqzbot
exabot
advbot
afilias web mining tool
aihitbot
backlinkcrawler
bdbrandprotect
betabot
blexbot
bpimagewalker*
catchbot
ccbot
cliqzbot
comodo ssl checker
comodo-certificates-spider
content crawler
crawler4j
curl
dcpbot
deusu
discobot
docomo/2.0
dotbot
drupact
ec2linkfinder
edisterbot
exabot
exb language crawler
experibot
ezooms
findlinks
gigablastopensource
go 1.1 package http
gonzo
gslfbot
htdig
httpget
huaweisymantecspider
icjobs
infohelfer
ips-agent
ipsagent
it2media-domain-crawler
java
kaloogabot
lb-spider
lex
libwww-perl
linkdex.com
linkpadbot
linkpad
linkstats
lssrocketcrawler
ltx71
magpie-crawler
mail.ru_bot
meanpath
meanpathbot
megaindex
megaindex.com
megaindex.ru
mfibot
mia
mindupbot
mlbot
mojeekbot
netestate ne crawler
nutch
obot
openindexspider
openlinkprofiler
opidoobot
pagepeeker
picmole
pixray-seeker
plukkie
publiclibraryarchive
qualidator*
qwantify
reverseget
riddler
safedns
safednsbot
savetheworldheritage
savetheworldheritage.org
schrein
scooter
screenerbot
semanticbot
semantic health web crawler
seoscanners
seznambot
sheerexplorer
sheerseo
slysearch
solomonobot
solomonolinkchecker
sosospider
spiderlytics
ssearch
suggybot
surveybot
swebot
tineye
turnitinbot
unister*
unisterbot
updownerbot
uptimebot
vebidoobot
wbsearchbot
webinator
webliste.ch
webliste
webmastercoffee
webmeup-crawler
webofantbot
wevikabot
x28-job-bot
xovibot
yacybot
yeti
yeti-mobile
youdaobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.kroschke.com/store/ksi17/de/sitemap/sitemap.xml
Back to top

Comments

  • prod
  • 15.4.2011
  • Disallow: /*?
  • Schadhafte Bots
Back to top

Warnings

  • 3 invalid lines.
Back to top