info-pflege.de
robots.txt
Robots Exclusion Standard data for info-pflege.de
Resource Scan
Scan Details
| Site Domain | info-pflege.de |
| Base Domain | info-pflege.de |
| Scan Status | Ok |
| Last Scan | 2024-09-28T21:37:14+00:00 |
| Next Scan | 2024-10-05T21:37:14+00:00 |
Last Scan
| Scanned | 2024-09-28T21:37:14+00:00 |
| URL | https://info-pflege.de/robots.txt |
| Redirect | https://www.info-pflege.de/robots.txt |
| Redirect Domain | www.info-pflege.de |
| Redirect Base | info-pflege.de |
| Domain IPs | 85.13.132.4 |
| Redirect IPs | 85.13.132.4 |
| Response IP | 85.13.132.4 |
| Found | Yes |
| Hash | 572fe67517f5511916332dc0af8a702d8a6dc36e93e2bcffbe6d1f7f98f1e859 |
| SimHash | 223a24a85da1 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /pflegeeinrichtungen/search.php |
| Disallow | /pflegeeinrichtungen/search.php?* |
| Disallow | /out |
| Disallow | /pflegeeinrichtungen/*%28 |
| Disallow | /captcha |
| Disallow | /spitr/ |
*
| Rule | Path |
|---|---|
| Disallow | /pflegeeinrichtungen/search.php |
| Disallow | /pflegeeinrichtungen/search.php?* |
| Disallow | /out |
| Disallow | /pflegeeinrichtungen/*%28 |
| Disallow | /captcha |
| Disallow | /spitr/ |
advbot
afilias web mining tool
aihitbot
archive.org_bot
backlinkcrawler
baiduspider
baidu
baiduspider+
baiduspider
bdbrandprotect
betabot
blexbot
bpimagewalker*
catchbot
ccbot
cliqzbot
comodo ssl checker
comodo-certificates-spider
content crawler
crawler4j
curl
dcpbot
deusu
discobot
docomo/2.0
dotbot
drupact
ec2linkfinder
edisterbot
exabot
exb language crawler
experibot
ezooms
findlinks
gigablastopensource
go 1.1 package http
gonzo
gslfbot
htdig
httpget
huaweisymantecspider
ia_archiver
icjobs
infohelfer
ips-agent
ipsagent
it2media-domain-crawler
java
jobboerse
kaloogabot
larbin
lb-spider
lex
libwww-perl
linkdex.com
linkpadbot
linkpad
linkstats
lssrocketcrawler
magpie-crawler
mail.ru_bot
meanpath
meanpathbot
megaindex
mia
mj12bot
mlbot
mojeekbot
msiecrawler
msnbot
netestate ne crawler
nutch
obot
openindexspider
openlinkprofiler
opidoobot
pagepeeker
picmole
pixray-seeker
plukkie
psbot
publiclibraryarchive
qualidator*
qwantify
reverseget
riddler
safedns
savetheworldheritage
savetheworldheritage.org
schrein
scooter
screenerbot
semantic health web crawler
seokicks
seokicks-robot
seoscanners
seznambot
sheerexplorer
sheerseo
siteexplorer/1.0b
siteexplorer
slysearch
solomonobot
solomonolinkchecker
sosospider
spbot
spiderlytics
ssearch
suggybot
surveybot
swebot
tineye
turnitinbot
unister*
unisterbot
updownerbot
uptimebot
vebidoobot
waybackarchive.org/1.0
waybackarchive.org
waybackarchive
wbsearchbot
webinator
webliste.ch
webliste
webmastercoffee
webmeup-crawler
webofantbot
wevikabot
wget
wotbox
wotbox
x28-job-bot
xovibot
yacybot
yandexbot/3.0
yandexbot
yandex
yandeximages/3.0
yandeximages
yeti
yeti-mobile
youdaobot
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 4 invalid lines.
Comments