imexdental.de
robots.txt

Robots Exclusion Standard data for imexdental.de

Resource Scan

Scan Details

Site Domain imexdental.de
Base Domain imexdental.de
Scan Status Ok
Last Scan2024-09-26T06:57:40+00:00
Next Scan 2024-10-26T06:57:40+00:00

Last Scan

Scanned2024-09-26T06:57:40+00:00
URL https://imexdental.de/robots.txt
Domain IPs 85.13.155.210
Response IP 85.13.155.210
Found Yes
Hash 5be151c4ea606fb7e14c98ce1d8a6f749033add622a4992c78a66cd1d9763d95
SimHash bb9ed1b36fbb

Groups

mozilla/5.0 (compatible; infotigerbot/1.9; +https://infotiger.com/bot)
applebot
mozilla/5.0 (macintosh; intel mac os x 10_15_5) applewebkit/605.1.15 (khtml, like gecko) version/13.1.1 safari/605.1.15 (applebot/0.1; +http://www.apple.com/go/applebot)
dataforseobot*
dataforseobot
mozilla/5.0 (compatible; dataforseobot; +https://dataforseo.com/dataforseo-bot)
mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)
mozilla/5.0 (compatible; censysinspect/1.1; +https://about.censys.io/)
adsbot
mozilla/5.0 (compatible; adsbot/3.1; +https://seostar.co/robot/)
adsbot/3.1 (+https://seostar.co/robot/)
mozilla/5.0 (compatible; mojeekbot/0.10; +https://www.mojeek.com/bot.html)
mojeekbot/0.10
mojeekbot*
test user agent
megaindex*
auskunftbot*
serpstatbot/2.0 beta (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)
serpstatbot*
melantech/nutch-1.16-snapshot
melantech*
python-requests/2.24.0
python-requests*
node-fetch/1.0 (+https://github.com/bitinn/node-fetch)
node-fetch*
piorbo*
adsbot/3.1
adsbot*
vagabond*
apache-httpclient/4.5.2 (java/1.8.0_232)
apache-httpclient*
checkmarknetwork*
vsusearchspider/1.0
implisensebot 1.1
netestate ne crawler (+http://www.website-datenbank.de/)
netestat*
crawler4j (https://github.com/yasserg/crawler4j/)
crawler4*
lcc
velenpublicwebcrawler*
velenpublicwebcrawler/1.0; +https://velen.io
photon/1.0
spider
curl*
cliqzbot*
ccbot*
ccbot/2.0 (https://commoncrawl.org/faq/)
go-http-client/2.0
zoominfobot
domaincrawler
domaincrawler*
info@domaincrawler.com; http://www.domaincrawler.com/www.le-service.de
qwantify/1.0
seekport crawler
mozilla/5.0 (compatible;clcrawler/1.0)
mozilla/5.0 (compatible; seekport crawler; http://seekport.com/)
mozilla/5.0 (compatible; qwantify/vr; https://www.qwant.com/)
mozilla/5.0 (compatible; qwantify/2.0n; https://www.qwant.com/)/*
mozilla/5.0 (compatible; qwantify/2.1n; https://www.qwant.com/)/*
mozilla/5.0 (compatible; qwantify/bleriot/1.1; +https://help.qwant.com/bot)
mozilla/5.0 (compatible; qwantify/bleriot/1.1; https://help.qwant.com/bot)
mozilla/5.0 (compatible; qwantify/mermoz/0.1; https://www.qwant.com/; https://www.github.com/qwantresearch/mermoz)
mozilla/5.0 (compatible; qwantify/2.4w; +https://www.qwant.com/)/2.4w
mozilla/5.0 (compatible; qwantify/2.4w; https://www.qwant.com/)/2.4w
mozilla/5.0 (compatible; seokicks; +https://www.seokicks.de/robot.html)
yandexbot/3.0
yandexbot
yandex*
spbot
gonzo
bookmarksearchtool
crescentinternettoolpakhttpolecontrolv.1.0
fairadclient
flamingattackbot
httrack3.0
kenjinspider
keyworddensity/0.9
linkscan/8.1aunix
matahari
microsofturlcontrol-5.01.4511
microsofturlcontrol-6.00.8169
microsofturlcontrol
misterpix
mozilla/4.0(compatible;bullseye;windows95)
offlineexplorer
openfinddatagatherer
oracleultrasearch
querynmetasearch
radiationretriever1.1
repomonkeybait&tackle/v1.01
theintraformant
urlcontrol
urlywarning
vciwebviewervciwebviewerwin32
webimagecollector
webcapture2.0
webcopierv.2.2
webcopierv3.2a
websitequester
websterpro
xenu'slinksleuth1.1c
zeus32297websterprov2.9win32
zeuslinkscout
seokicks
majesticseo
backlinkcrawler
xovi
xovibot
spbot
search17
ia_archiver
slysearch
findlinks
pixray-seeker
ezooms
lb-spider
huaweisymantecspider
ec2linkfinder
htdig
discobot
linkdex.com
seznambot
edisterbot
swebot
picmole
yeti
yeti-mobile
pagepeeker
catchbot
yacybot
netestatenecrawler
surveybot
comodosslchecker
comodo-certificates-spider
gonzo
schrein
afiliaswebminingtool
suggybot
bdbrandprotect
bpimagewalker
updownerbot
lex
contentcrawler
dcpbot
kaloogabot
mlbot
obot
webmastercoffee
qualidator
webinator
scooter
thunderstone
opidoobot
ips-agent
tineye
unisterbot
unister
reverseget
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot
ahrefsbot
seoscanners.net
aihitbot
blexbot
cliqzbot
dotbot
linkdexbot
mj12bot
seokicks-robot
searchmetricsbot
careerbot
rapeshotcrawler
icjobs
magpie-crawler
proximic
queryseekerspider
vagabondo
wbsearchbot
surferseo
alexibot
aqua_products
asterias
b2w/0.1
backdoorbot/1.0
blowfish/1.0
bookmark search tool
botalot
botrighthere
builtbottough
bullseye/1.0
bunnyslippers
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copernic
copyrightcheck
cosmos
crescent internet toolpak http ole control v.1.0
crescent
dittospyder
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
fairad client
flaming attackbot
foobot
gaisbot
getright/4.2
harvest/1.5
hloader
httplib
httrack 3.0
humanlinks
infonavirobot
iron33/1.0.2
jennybot
kenjin spider
keyword density/0.9
larbin
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lnspiderguy
lwp-trivial/1.34
lwp-trivial
mata hari
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
microsoft url control
miixpc/4.2
miixpc
mister pix
moget/2.1
moget
mozilla/4.0 (compatible; bullseye; windows 95)
msiecrawler
netants
nicerspro
offline explorer
openbot
openfind data gatherer
openfind
oracle ultra search
perman
propowerbot/2.14
prowebwalker
psbot
python-urllib
queryn metasearch
radiation retriever 1.1
repomonkey bait & tackle/v1.01
repomonkey
rma
searchpreview
sitesnagger
spankbot
spanner
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
tocrawl/urldispatcher
true_robot/1.0
true_robot
turingos
turnitinbot/1.5
turnitinbot
url control
url_spider_pro
urly warning
vci webviewer vci webviewer win32
vci
web image collector
webauto
webbandit/3.50
webbandit
webcapture 2.0
webcopier v.2.2
webcopier v3.2a
webcopier
webenhancer
websauger
website quester
webster pro
webstripper
webzip/4.0
webzip/4.21
webzip/5.0
webzip
wget/1.5.3
wget/1.6
wget
wget
www-collector-e
xenu's link sleuth 1.1c
xenu's
zeus 32297 webster pro v2.9 win32
zeus link scout
zeus

Rule Path
Disallow /

pricebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

indeedbot 1.1

Rule Path
Allow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow testing.imex-dental.de
Disallow crom.imexdental.de
Disallow cron.imexdental.de
Disallow demo.imexdental.de
Disallow dentmap.imexdental.de
Disallow dev.imexdental.de
Disallow import.imexdental.de
Disallow karriere.imexdental.de
Disallow kundenbenchmark.imexdental.de
Disallow kundenkarte.imexdental.de
Disallow laravelbackend.imexdental.de
Disallow laravelbackenddemo.imexdental.de
Disallow lieferzeiten.imexdental.de
Disallow login.imexdental.de
Disallow map.imexdental.de
Disallow mein.imexdental.de
Disallow my-apimodul.imexdental.de
Disallow my.imexdental.de
Disallow myservices-staging.imexdental.de
Disallow myservices.imexdental.de
Disallow myupgrade.imexdental.de
Disallow preview.imexdental.de
Disallow staging-2024.imexdental.de
Disallow test-onlineabholung-vue.imexdental.de
Disallow zahnersatzrechner.imexdental.de
Disallow zahnrechner-proxy.imexdental.de
Disallow zahnrechner.imexdental.de
Disallow staging.kundenkarte.imexdental.de
Disallow www.mein.imexdental.de
Disallow staging-dev.my.imexdental.de
Disallow staging.my.imexdental.de
Disallow staging.myupgrade.imexdental.de
Disallow demo.onlineabholungen.imexdental.de
Disallow old.onlineabholungen.imexdental.de
Disallow staging.onlineabholungen.imexdental.de
Disallow webservice.onlineabholungen.imexdental.de
Disallow staging.webservice.onlineabholungen.imexdental.de
Disallow staging.webservice.zahnrechner.imexdental.de
Disallow staging.zahnrechner-proxy.imexdental.de
Disallow staging.zahnrechner.imexdental.de

Other Records

Field Value
sitemap https://www.imexdental.de/sitemap_index.xml
sitemap https://www.imexdental.de/page-sitemap.xml

Comments

  • _____ __ __ ________ __ _____ _ _ _ _______ _ _ _ _____ _ _ _
  • |_ _| \/ | ____\ \ / / | __ \ | | | | | | |__ __| | | (_| | / ____| | | | | | |
  • | | | \ / | |__ \ V / | | | | ___ _ __ | |_ __ _| | _ _ _ __ __| | | | ___ ___| |__ _ __ _| | __ | | __ _ __ ___ | |__ | |__| |
  • | | | |\/| | __| > < | | | |/ _ | '_ \| __/ _` | | | | | | '_ \ / _` | | |/ _ \/ __| '_ \| '_ \| | |/ / | | |_ | '_ ` _ \| '_ \| __ |
  • _| |_| | | | |____ / . \ | |__| | __| | | | || (_| | | | |_| | | | | (_| | | | __| (__| | | | | | | | < | |__| | | | | | | |_) | | | |
  • |_____|_| |_|______/_/ \_\ |_____/ \___|_| |_|\__\__,_|_| \__,_|_| |_|\__,_| |_|\___|\___|_| |_|_| |_|_|_|\_\ \_____|_| |_| |_|_.__/|_| |_|
  • Robots.txt by Somsak
  • (c) IMEX Dental und Technik GmbH
  • Bonsiepen 6, 45136 Essen

Warnings

  • 4 invalid lines.