janolaw.de
robots.txt

Robots Exclusion Standard data for janolaw.de

Resource Scan

Scan Details

Site Domain janolaw.de
Base Domain janolaw.de
Scan Status Ok
Last Scan2024-09-21T12:48:06+00:00
Next Scan 2024-10-21T12:48:06+00:00

Last Scan

Scanned2024-09-21T12:48:06+00:00
URL https://janolaw.de/robots.txt
Domain IPs 151.106.64.66
Response IP 151.106.64.66
Found Yes
Hash 0f062b7c46e01d7e3fc68671dd23c3bd8083216d4f5499d403b506eb2c872cb6
SimHash f85d6f550e03

Groups

domains project/1.0.6

Rule Path
Disallow /

lcc

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot/2.0 (https://commoncrawl.org/faq/)

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

exabot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

orangebot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

mozilla/5.0 (x11; u; linux i686; en-us; rv:1.2.1; aggregator:spinn3r (spinn3r 3.1); http://spinn3r.com/robot) gecko/20021130

Rule Path
Disallow /

mozilla/5.0 (compatible; gluten free crawler/1.0; +http://glutenfreepleasure.com/)

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

scooter

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

slurp

Rule Path
Disallow /

spbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

newspaper/0.2.8

Rule Path
Disallow /

wget
webzip

Rule Path
Disallow

*

Rule Path
Disallow /opencms/opencms/
Disallow /opencms/contract/
Disallow /agb-service/shops/
Disallow /agb-service/shops/*_include.html
Disallow /export/sites/default/vorlagen/konfigurator/protokolle/
Disallow /export/sites/default/vorlagen/konfigurator/vorschau/
Disallow /*?addArticleToCart=*
Disallow /*?generateContract=*
Disallow */volltexturteile/*
Disallow /opencms/export/sites/default/vorlagen/
Disallow /system/modules/de.janolaw.site/elements/renderXML/showTable.jsp
Disallow /partner/

Other Records

Field Value
sitemap https://www.janolaw.de/sitemap.xml

Comments

  • https://www.janolaw.de/robots.txt