dentnet.de
robots.txt
Robots Exclusion Standard data for dentnet.de
Resource Scan
Scan Details
| Site Domain | dentnet.de |
| Base Domain | dentnet.de |
| Scan Status | Ok |
| Last Scan | 2024-06-09T06:28:01+00:00 |
| Next Scan | 2024-07-09T06:28:01+00:00 |
Last Scan
| Scanned | 2024-06-09T06:28:01+00:00 |
| URL | https://dentnet.de/robots.txt |
| Redirect | https://www.dentnet.de/robots.txt |
| Redirect Domain | www.dentnet.de |
| Redirect Base | dentnet.de |
| Domain IPs | 85.13.155.210 |
| Redirect IPs | 85.13.155.210 |
| Response IP | 85.13.155.210 |
| Found | Yes |
| Hash | 136dfa6338498fd3c29a680c285ea5c0543f3b5542e45648e10928325592cbfd |
| SimHash | b31c53f26fb2 |
Groups
mozilla/5.0 (compatible; infotigerbot/1.9; +https://infotiger.com/bot)
applebot
mozilla/5.0 (macintosh; intel mac os x 10_15_5) applewebkit/605.1.15 (khtml, like gecko) version/13.1.1 safari/605.1.15 (applebot/0.1; +http://www.apple.com/go/applebot)
dataforseobot*
dataforseobot
mozilla/5.0 (compatible; dataforseobot; +https://dataforseo.com/dataforseo-bot)
mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)
mozilla/5.0 (compatible; censysinspect/1.1; +https://about.censys.io/)
adsbot
mozilla/5.0 (compatible; adsbot/3.1; +https://seostar.co/robot/)
adsbot/3.1 (+https://seostar.co/robot/)
mozilla/5.0 (compatible; mojeekbot/0.10; +https://www.mojeek.com/bot.html)
mojeekbot/0.10
mojeekbot*
test user agent
megaindex*
auskunftbot*
serpstatbot/2.0 beta (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)
serpstatbot*
melantech/nutch-1.16-snapshot
melantech*
python-requests/2.24.0
python-requests*
node-fetch/1.0 (+https://github.com/bitinn/node-fetch)
node-fetch*
piorbo*
adsbot/3.1
adsbot*
vagabond*
apache-httpclient/4.5.2 (java/1.8.0_232)
apache-httpclient*
checkmarknetwork*
vsusearchspider/1.0
implisensebot 1.1
netestate ne crawler (+http://www.website-datenbank.de/)
netestat*
crawler4j (https://github.com/yasserg/crawler4j/)
crawler4*
lcc
velenpublicwebcrawler*
velenpublicwebcrawler/1.0; +https://velen.io
photon/1.0
spider
curl*
cliqzbot*
ccbot*
ccbot/2.0 (https://commoncrawl.org/faq/)
go-http-client/2.0
zoominfobot
domaincrawler
domaincrawler*
info@domaincrawler.com; http://www.domaincrawler.com/www.le-service.de
qwantify/1.0
seekport crawler
mozilla/5.0 (compatible;clcrawler/1.0)
mozilla/5.0 (compatible; seekport crawler; http://seekport.com/)
mozilla/5.0 (compatible; qwantify/vr; https://www.qwant.com/)
mozilla/5.0 (compatible; qwantify/2.0n; https://www.qwant.com/)/*
mozilla/5.0 (compatible; qwantify/2.1n; https://www.qwant.com/)/*
mozilla/5.0 (compatible; qwantify/bleriot/1.1; +https://help.qwant.com/bot)
mozilla/5.0 (compatible; qwantify/bleriot/1.1; https://help.qwant.com/bot)
mozilla/5.0 (compatible; qwantify/mermoz/0.1; https://www.qwant.com/; https://www.github.com/qwantresearch/mermoz)
mozilla/5.0 (compatible; qwantify/2.4w; +https://www.qwant.com/)/2.4w
mozilla/5.0 (compatible; qwantify/2.4w; https://www.qwant.com/)/2.4w
mozilla/5.0 (compatible; seokicks; +https://www.seokicks.de/robot.html)
yandexbot/3.0
yandexbot
yandex*
spbot
gonzo
bookmarksearchtool
crescentinternettoolpakhttpolecontrolv.1.0
fairadclient
flamingattackbot
httrack3.0
kenjinspider
keyworddensity/0.9
linkscan/8.1aunix
matahari
microsofturlcontrol-5.01.4511
microsofturlcontrol-6.00.8169
microsofturlcontrol
misterpix
mozilla/4.0(compatible;bullseye;windows95)
offlineexplorer
openfinddatagatherer
oracleultrasearch
querynmetasearch
radiationretriever1.1
repomonkeybait&tackle/v1.01
theintraformant
urlcontrol
urlywarning
vciwebviewervciwebviewerwin32
webimagecollector
webcapture2.0
webcopierv.2.2
webcopierv3.2a
websitequester
websterpro
xenu'slinksleuth1.1c
zeus32297websterprov2.9win32
zeuslinkscout
seokicks
majesticseo
backlinkcrawler
xovi
xovibot
spbot
search17
ia_archiver
slysearch
findlinks
pixray-seeker
ezooms
lb-spider
huaweisymantecspider
ec2linkfinder
htdig
discobot
linkdex.com
seznambot
edisterbot
swebot
picmole
yeti
yeti-mobile
pagepeeker
catchbot
yacybot
netestatenecrawler
surveybot
comodosslchecker
comodo-certificates-spider
gonzo
schrein
afiliaswebminingtool
suggybot
bdbrandprotect
bpimagewalker
updownerbot
lex
contentcrawler
dcpbot
kaloogabot
mlbot
obot
webmastercoffee
qualidator
webinator
scooter
thunderstone
opidoobot
ips-agent
tineye
unisterbot
unister
reverseget
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot
ahrefsbot
seoscanners.net
aihitbot
blexbot
cliqzbot
dotbot
linkdexbot
mj12bot
seokicks-robot
searchmetricsbot
careerbot
rapeshotcrawler
icjobs
magpie-crawler
proximic
queryseekerspider
vagabondo
wbsearchbot
surferseo
alexibot
aqua_products
asterias
b2w/0.1
backdoorbot/1.0
blowfish/1.0
bookmark search tool
botalot
botrighthere
builtbottough
bullseye/1.0
bunnyslippers
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copernic
copyrightcheck
cosmos
crescent internet toolpak http ole control v.1.0
crescent
dittospyder
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
fairad client
flaming attackbot
foobot
gaisbot
getright/4.2
harvest/1.5
hloader
httplib
httrack 3.0
humanlinks
infonavirobot
iron33/1.0.2
jennybot
kenjin spider
keyword density/0.9
larbin
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lnspiderguy
lwp-trivial/1.34
lwp-trivial
mata hari
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
microsoft url control
miixpc/4.2
miixpc
mister pix
moget/2.1
moget
mozilla/4.0 (compatible; bullseye; windows 95)
msiecrawler
netants
nicerspro
offline explorer
openbot
openfind data gatherer
openfind
oracle ultra search
perman
propowerbot/2.14
prowebwalker
psbot
python-urllib
queryn metasearch
radiation retriever 1.1
repomonkey bait & tackle/v1.01
repomonkey
rma
searchpreview
sitesnagger
spankbot
spanner
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
tocrawl/urldispatcher
true_robot/1.0
true_robot
turingos
turnitinbot/1.5
turnitinbot
url control
url_spider_pro
urly warning
vci webviewer vci webviewer win32
vci
web image collector
webauto
webbandit/3.50
webbandit
webcapture 2.0
webcopier v.2.2
webcopier v3.2a
webcopier
webenhancer
websauger
website quester
webster pro
webstripper
webzip/4.0
webzip/4.21
webzip/5.0
webzip
wget/1.5.3
wget/1.6
wget
wget
www-collector-e
xenu's link sleuth 1.1c
xenu's
zeus 32297 webster pro v2.9 win32
zeus link scout
zeus
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /typo3/ |
| Disallow | /typo3_src/ |
| Disallow | /fileadmin/t3 |
| Disallow | /fileadmin/scripts |
| Disallow | /fileadmin/dentnet/Public/files |
| Disallow | *.sql |
| Disallow | *.sql.gz |
| Disallow | /typo3temp/var/* |
| Disallow | /*/private/* |
| Disallow | /*/configuration/* |
| Disallow | *?tx_rating_htmlapi* |
| Disallow | *?tx_news_pi1* |
| Disallow | /*?tx_blog_tag%5BcurrentPage%5D=* |
| Disallow | /*?tx_blog_category%5BcurrentPage%5D=* |
| Disallow | /kategorie/ |
| Disallow | /kategorie/* |
| Disallow | /*/kategorie/* |
| Disallow | *tx_rating_jsonapi* |
| Disallow | *?tx_rating_jsonapi* |
| Disallow | *tx_rating_htmlapi* |
| Disallow | *?tx_rating_htmlapi* |
| Disallow | *?tx_rating* |
| Disallow | *?tx_news* |
| Disallow | *tx_rating* |
| Disallow | *tx_news* |
| Disallow | */1000 |
| Disallow | /*/1000 |
| Disallow | /barmenia_Tarif_MehrZahn80.pdf |
| Disallow | /DentNet_Teilnahmeerklaerung_fuer_Patienten.pdf |
| Disallow | /20232912_DN_Krankenkassenliste_DIN_A4.pdf |
| Disallow | /dokument_dentnet_mit-schoenen-zaehnen-das-leben-geniessen.pdf |
| Disallow | /dokument_dentnet_patienteninformation-zur-teilnahme-am-dentnet.pdf |
| Disallow | /dokument_dentnet_beurteilungsbogen-fuer-patienten.pdf |
| Disallow | /dokument_dentnet_krankenkassen.pdf |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dentnet.de/sitemap.xml |
| sitemap | https://www.dentnet.de/sitemap.xml?sitemap=pages |
| sitemap | https://www.dentnet.de/sitemap.xml?sitemap=news |
Warnings
- 4 invalid lines.
Comments