klinik-db.de
robots.txt
Robots Exclusion Standard data for klinik-db.de
Resource Scan
Scan Details
Site Domain | klinik-db.de |
Base Domain | klinik-db.de |
Scan Status | Ok |
Last Scan | 2024-11-19T09:36:59+00:00 |
Next Scan | 2024-11-26T09:36:59+00:00 |
Last Scan
Scanned | 2024-11-19T09:36:59+00:00 |
URL | https://klinik-db.de/robots.txt |
Domain IPs | 188.40.26.228, 2a01:4f8:d0a:1372::2 |
Response IP | 188.40.26.228 |
Found | Yes |
Hash | abbff44ee6fddf13d0d0f07737a96909f63ad3ab3aaf74e42ab0915aded32a96 |
SimHash | 7f954272c9b6 |
Groups
admantx
aibot
alittle client
aspseek
abonti
aboundex
aboundexbot
adstxtcrawlertp
afd-verbotsverfahren
aihitbot
aipbot
allsubmitter
anarchie
anarchy
anarchy99
petalbot
ia_archiver
archive.org_bot
ia_archiver-web.archive.org
barkrowler
aacrawler
accompanybot
adbot
adsbot
alligator
alphabot
ahrefsbot
ankit
alexibot
anthill
apexoo
aqua_products
asterias
atomic_email_hunter
b2w/0.1
backdoorbot/1.0
backlinkcrawler
baiduspider
baiduspider+
baiduspider-cpro
baiduspider-favo
baiduspider-image
baiduspider-mobile
baiduspider-news
baiduspider-sfkr
baiduspider-video
blowfish/1.0
bookmark search tool
botalot
botrighthere
builtbottough
bullseye/1.0
bunnyslippers
ccbot
check url bot
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
cityreview
copernic
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
cyberpatrol sitecat webbot
dittospyder
domainwatcher
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
exooba
extractorpro
ezooms/1.0
fairad client
fasterfox
flaming attackbot
foobot
gaisbot
getright/4.2
gigabot
grapeshotcrawler/2.0
grapefx/0.9
harvest/1.5
heritrix
hloader
httplib
httrack
httrack 3.0
humanlinks
ia_archiver
ia_archiver/1.6
iccrawler - icjobs
infohelfer/1.3.0
infonavirobot
iron33/1.0.2
jennybot
jobs.de-robot
kenjin spider
keyword density/0.9
larbin
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lnspiderguy
lwp-trivial
lwp-trivial/1.34
mail.ru
mail.ru_bot/2.0
magpie-crawler/1.1
mata hari
miixpc
miixpc/4.2
mister pix
mj12bot
mj12bot/v1.4.3
mlbot
moget
moget/2.1
netants
netestate ne crawler
nicerspro
offline explorer
onetszukaj
openbot
openfind
openfind data gatherer
oracle ultra search
perman
propowerbot/2.14
prowebwalker
proximic
psbot
python-urllib
queryn metasearch
radiation retriever 1.1
repomonkey
repomonkey bait & tackle/v1.01
rma
scoutjet
seznambot/3.0
searchpreview
spbot/3.1
sitesnagger
spankbot
spanner
sosospider/2.0
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
tocrawl/urldispatcher
toplistbot
true_robot
true_robot/1.0
turingos
turnitinbot
turnitinbot/1.5
twiceler
twiceler.
url control
urlspion
url_spider_pro
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webalta crawler
webauto
webbandit
webbandit/3.50
webbericht.com ?
webcapture 2.0
webcopier
webcopier v.2.2
webcopier v3.2a
webdatacentrebot
webenhancer
websauger
website quester
webster pro
webstripper
webwiki
webzip
webzip/4.0
webzip/4.21
webzip/5.0
wget
wget
wget/1.5.3
wget/1.6
www-collector-e
xenu´s
xenu´s link sleuth 1.1c
yandex
yandexbot/3.0
yeti
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
gptbot
Rule | Path |
---|---|
Disallow | / |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
sitemap | https://klinik-db.de/site/sitemap.xml |
sitemap | https://iovodoc.de/site/sitemap.xml |
Warnings
- 6 invalid lines.