baiduspider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
barkrowler
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
barkrowler/0.9
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
blexbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
ccbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
2 |
clark-crawler2
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
cliqzbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
2 |
domains project
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
2 |
expo9
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
extlinksbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
2 |
femtosearchbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
2 |
gigabot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
grapeshot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
hyscore
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
infotigerbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
mj12bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
mozilla
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
mozilla/5.0 (compatible; optimizer)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
neevabot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
nutch
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
optimizer
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
4 |
screaming frog seo spider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
seekport
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
seekportbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
semrushbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
semrushbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
seokicks
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
seo-macroscope
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
seomacroscope
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
serendeputybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
sistrix
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
4 |
sitebulb
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
4 |
turnitinbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3 |
uipbot/1.0 (uipbot@semasio.net)
yacybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
2 |
xovibot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
4 |
yandex
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
4 |
yioopbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
4 |
*
| Rule |
Path |
| Disallow |
/dienste/lex2/ |
| Disallow |
/benutzer.php |
| Disallow |
/benutzer |
| Disallow |
/dienste/extern |
| Disallow |
/dienste/merkliste |
| Disallow |
/dienste/verlauf |
| Disallow |
/cgi-bin/ajax_antworter.fcgi |
| Disallow |
/cgi-bin/jquery-suche.fcgi |
| Disallow |
/cgi-bin/kurzurl.fcgi |
| Disallow |
/apple-app-site-association |
| Disallow |
/.well-known |
| Disallow |
/ext |
| Disallow |
/wiki |
| Disallow |
/jcg/*.mp4$ |
| Disallow |
/aenderungen/Synopse-BGB-2008.pdf |
| Disallow |
/aenderungen/Synopse-BGB-2009.pdf |
| Disallow |
/aenderungen/Synopse-GmbHG-2008.pdf |
| Disallow |
/aenderungen/Synopse-Grundgesetz.pdf |
| Disallow |
/aenderungen/Synopse-GWB-2009.pdf |
| Disallow |
/aenderungen/Synopse-PolG-2008.pdf |
| Disallow |
/aenderungen/Synopse-StPO-2008.pdf |
| Disallow |
/aenderungen/Synopse-UrhG-2008.pdf |
| Disallow |
/aenderungen/Synopse-UWG-2009.pdf |
| Disallow |
/aenderungen/Synopse-VVG-2009.pdf |
| Disallow |
/dienste/vernetzung/rechtsprechung?Gericht=BVerfG&Datum=31.12.2222&$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Gericht=BVerfG&Datum=31.12.2222&...$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Gericht=EuGH&Datum=31.12.2222$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=DB%202015%2C%207$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=DStR%202013%2C%2013$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=DStR%202013%2C%2014$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=DStR%202014%2C%206$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=NJW%2012%2C%2010$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=NJW%202012%2C%206$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=NJW%202016%2C%208$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=NStZ-RR%202017%2C%205$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=NVwZ%202013%2C%206$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=NZARR%202013%2C%206$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=NZA-RR%202013%2C%206$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=StBW%202008%2C%202$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=StBW%202008%2C%205$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=StBW%202009%2C%202$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=StBW%202009%2C%205$ |
| Disallow |
/dienste/vernetzung/rechtsprechung?Text=StBW%202007%20S.%204$ |