Log In Sign Up

typolexikon.de
robots.txt

Robots Exclusion Standard data for typolexikon.de

Resource Scan

Scan Details

Site Domain typolexikon.de
Base Domain typolexikon.de
Scan Status Ok
Last Scan2024-11-04T10:37:54+00:00
Next Scan 2024-12-04T10:37:54+00:00

Last Scan

Scanned2024-11-04T10:37:54+00:00
URL https://typolexikon.de/robots.txt
Domain IPs 217.160.0.114
Response IP 217.160.0.114
Found Yes
Hash 056833a771361e28138aef68a3de5a8453d49c3afaa5ed4f436713200b73fc15
SimHash 1a4d205064f0

Groups

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole

adscanner

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

buck

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

cloudservermarketspider

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

dnbcrawler-analytics

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

e.ventures investment crawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ev-crawler

Rule Path
Disallow /

evc-batch

Rule Path
Disallow /

evc-batch/2.0

Rule Path
Disallow /

fr-crawler

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

gosign-security-crawler

Rule Path
Disallow /

iccrawler

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

implisensebot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

keybot translation

Rule Path
Disallow /

kraken

Rule Path
Disallow /

linguee

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

linkstats

Rule Path
Disallow /

lipperhey-kaus-australis

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

mega-index

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.com/2.0

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mindupbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

netestatenecrawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

plista

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

python/3.5 aiohttp

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

rc-crawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

sabsimbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seo scanner

Rule Path
Disallow /

seo scanner/1.2.4

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sg-orbiter

Rule Path
Disallow /

siteimprove.com bot

Rule Path
Disallow /

siteimprove.com

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

siteliner

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

slackbot-linkexpanding 1.0

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

thumbsniper

Rule Path
Disallow /

toweya.com

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

vebidoobot/1.0

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.typolexikon.de/post-sitemap.xml
sitemap https://www.typolexikon.de/attachment-sitemap.xml
sitemap https://www.typolexikon.de/post_tag-sitemap.xml
sitemap https://www.typolexikon.de/page-sitemap.xml
Back to top

Comments

  • Sitemaps
  • Update 2022-07-20
  • Disallow Files
  • Update 2023-05-13
  • Disallow Bots
  • Update 2023-06-22
  • A
  • B
  • C
  • D
  • E
  • F
  • G
  • I
  • J
  • K
  • L
  • M
  • N
  • O
  • P
  • Q
  • R
  • S
  • T
  • U
  • V
  • W
  • Z
Back to top