datenschutz-janolaw.de
robots.txt

Robots Exclusion Standard data for datenschutz-janolaw.de

Archived Snapshots

Resource Scan

Scan Details

Site Domain	datenschutz-janolaw.de
Base Domain	datenschutz-janolaw.de
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Couldn't establish SSL connection.
Last Scan	2024-09-17T17:30:20+00:00
Next Scan	2024-10-17T17:30:20+00:00

Last Successful Scan

Scanned	2024-07-27T14:21:06+00:00
URL	https://datenschutz-janolaw.de/robots.txt
Domain IPs	151.106.64.67
Response IP	151.106.64.67
Found	Yes
Hash	6e0fddc51d1cba05283a92627ff6e63a5338a9a727af51f679d59afc55d6c56f
SimHash	f81c6f554403

Groups

domains project/1.0.6

Rule	Path
Disallow	/

Rule

Path

Disallow

lcc

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

alphabot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot/2.0 (https://commoncrawl.org/faq/)

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

deusu

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

istellabot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

magpie-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

mojeekbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mediatoolkitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

metajobbot

Rule	Path
Disallow	/

Rule

Path

Disallow

orangebot

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

seoscanners.net

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (x11; u; linux i686; en-us; rv:1.2.1; aggregator:spinn3r (spinn3r 3.1); http://spinn3r.com/robot) gecko/20021130

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; gluten free crawler/1.0; +http://glutenfreepleasure.com/)

Rule	Path
Disallow	/

Rule

Path

Disallow

safednsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

scooter

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot/2~bl

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ba

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-bm

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

scoutjet

Rule	Path
Disallow	/

Rule

Path

Disallow

smtbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spinn3r

Rule	Path
Disallow	/

Rule

Path

Disallow

slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexantivirus

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot/3.0

Rule	Path
Disallow	/

Rule

Path

Disallow

yandeximages

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexmobilebot

Rule	Path
Disallow	/

Rule

Path

Disallow

yeti

Rule	Path
Disallow	/

Rule

Path

Disallow

wget
webzip

Rule	Path
Disallow

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.datenschutz-janolaw.de/sitemap.xml

Field

Value

sitemap

https://www.datenschutz-janolaw.de/sitemap.xml

Comments

http://www.datenschutz-janolaw.de/robots.txt

datenschutz-janolaw.derobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

domains project/1.0.6

lcc

ahrefsbot

alphabot

blexbot

ccbot/2.0 (https://commoncrawl.org/faq/)

cliqzbot

dotbot

deusu

exabot

istellabot

mj12bot

magpie-crawler

mojeekbot

mail.ru_bot

mediatoolkitbot

megaindex.ru/2.0

metajobbot

orangebot

proximic

seoscanners.net

seokicks-robot

seokicks

mozilla/5.0 (x11; u; linux i686; en-us; rv:1.2.1; aggregator:spinn3r (spinn3r 3.1); http://spinn3r.com/robot) gecko/20021130

mozilla/5.0 (compatible; gluten free crawler/1.0; +http://glutenfreepleasure.com/)

safednsbot

scooter

semrushbot

semrushbot/2~bl

semrushbot-ba

semrushbot-bm

semrushbot-sa

seznambot

scoutjet

smtbot

spinn3r

slurp

spbot

turnitinbot

yandexantivirus

yandexbot/3.0

yandeximages

yandexmobilebot

yeti

wgetwebzip

Other Records

Comments

datenschutz-janolaw.de
robots.txt

wget
webzip