havelritter.de
robots.txt
Robots Exclusion Standard data for havelritter.de
Resource Scan
Scan Details
| Site Domain | havelritter.de |
| Base Domain | havelritter.de |
| Scan Status | Ok |
| Last Scan | 2024-10-05T19:33:42+00:00 |
| Next Scan | 2024-10-12T19:33:42+00:00 |
Last Scan
| Scanned | 2024-10-05T19:33:42+00:00 |
| URL | https://havelritter.de/robots.txt |
| Domain IPs | 2001:1520:a:83::, 92.204.239.131 |
| Response IP | 92.204.239.131 |
| Found | Yes |
| Hash | e5896069521875fded7e07ea3489c8645846c42a5fe32492338f3b92f6c569f7 |
| SimHash | 12cc6313e468 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/cache/ |
| Disallow | /comments/ |
| Disallow | /author/ |
| Disallow | /impressum/ |
| Disallow | /datenschutzerklaerung/ |
| Disallow | /go/ |
| Disallow | /affiliate/ |
| Disallow | /amazon/ |
| Disallow | /partner/ |
| Disallow | /foo/ |
| Disallow | /test/ |
| Disallow | /old/ |
| Disallow | /ex/ |
| Disallow | /werbung/ |
| Allow | /wp-includes/js/ |
| Allow | /*.css |
| Allow | /*.js |
adscanner
advanced backlink tracking bot
ahrefsbot
aihitbot
at-bot
backlinkcrawler
barkrowler
bidswitchbot
blexbot
ccbot
censysinspect
cliqzbot
cloudservermarketspider
coccoc
dataxu
df bot 1.0
domain re-animator bot
domains project
domainstatsbot
domaintaggingbot
dotbot
exabot
fr-crawler
grapeshotcrawler
haosouspider
hubspot crawler
iccrawler
implisensebot
intelx.io_bot
internet-structure-research-project-bot
jobboersebot
jusprog â domain crawler
kraken
linkdexbot
linkisbot
linkstats
lipperhey-kaus-australis
magpie-crawler
meanpathbot
megaindex.com
megaindex.ru
metajobbot
mindupbot
mindupbot (datenbutler.de)
mj12bot
netpeakcheckerbot
obot
openhosebot
plista
plukkie
qwantify
r6_commentreader
rogerbot
rytebot
safednsbot
screaming frog seo spider
searchmetricsbot
semanticbot
semrushbot
semrushbot-ba
semrushbot-coub
semrushbot-ct
semrushbot-si
semrushbot-swa
seobilitybot
seodiver
seokicks
seokicks-robot
seoscanners.net
serpstatbot
sg-orbiter
sistrix
sistrix crawler
siteauditbot
smtbot
spbot
spiderbot
splitsignalbot
surdotlybot
surveybot
strucr
thumbsniper
trendictionbot
turnitinbot
um-ic
unisterbot
vebidoobot
wappalyzer
wbsearchbot
woorankreview
wotbox
xovi
yak
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 3 invalid lines.
Comments