monitorhalterung.de
robots.txt

Robots Exclusion Standard data for monitorhalterung.de

Archived Snapshots

Resource Scan

Scan Details

Site Domain	monitorhalterung.de
Base Domain	monitorhalterung.de
Scan Status	Ok
Last Scan	2024-09-10T17:30:54+00:00
Next Scan	2024-10-10T17:30:54+00:00

Last Scan

Scanned	2024-09-10T17:30:54+00:00
URL	https://monitorhalterung.de/robots.txt
Redirect	https://www.monitorhalterung.de/robots.txt
Redirect Domain	www.monitorhalterung.de
Redirect Base	monitorhalterung.de
Domain IPs	109.71.74.167, 2a05:cc00::74:167:10
Redirect IPs	109.71.74.167, 2a05:cc00::74:167:10
Response IP	109.71.74.167
Found	Yes
Hash	8e7901dc631bdc57fc6d5dede7f1552d23c8c478cc5e75126fe61437c14f16bb
SimHash	48ea34394ef9

Groups

*

Rule	Path
Allow	/
Disallow	/*account/
Disallow	/*checkout/
Disallow	/*widgets/
Disallow	/*navigation/
Disallow	/*bundles/
Disallow	/*.dwg
Disallow	/*.dxg
Disallow	/*.pdf
Disallow	/*.stp

Rule

Path

Allow

Disallow

/*account/

Disallow

/*checkout/

Disallow

/*widgets/

Disallow

/*navigation/

Disallow

/*bundles/

Disallow

/*.dwg

Disallow

/*.dxg

Disallow

/*.pdf

Disallow

/*.stp

advbot

Rule	Path
Disallow	/

Rule

Path

Disallow

afilias web mining tool

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot/3.0

Rule	Path
Disallow	/

Rule

Path

Disallow

aihitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinkcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

baidu

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider+

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

bdbrandprotect

Rule	Path
Disallow	/

Rule

Path

Disallow

betabot

Rule	Path
Disallow	/

Rule

Path

Disallow

bezeqint

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bpimagewalker*

Rule	Path
Disallow	/

Rule

Path

Disallow

catchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

comodo ssl checker

Rule	Path
Disallow	/

Rule

Path

Disallow

comodo-certificates-spider

Rule	Path
Disallow	/

Rule

Path

Disallow

content crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

crazywebcrawler-spider

Rule	Path
Disallow	/

Rule

Path

Disallow

curl

Rule	Path
Disallow	/

Rule

Path

Disallow

dcpbot

Rule	Path
Disallow	/

Rule

Path

Disallow

deusu

Rule	Path
Disallow	/

Rule

Path

Disallow

discobot

Rule	Path
Disallow	/

Rule

Path

Disallow

docomo/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler/3.0

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

drupact

Rule	Path
Disallow	/

Rule

Path

Disallow

ec2linkfinder

Rule	Path
Disallow	/

Rule

Path

Disallow

edisterbot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

exb language crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

findlinks

Rule	Path
Disallow	/

Rule

Path

Disallow

fr-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

gigablastopensource

Rule	Path
Disallow	/

Rule

Path

Disallow

gigablastopensource/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

gluten free crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

gluten free crawler/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

go 1.1 package http

Rule	Path
Disallow	/

Rule

Path

Disallow

gonzo

Rule	Path
Disallow	/

Rule

Path

Disallow

gslfbot

Rule	Path
Disallow	/

Rule

Path

Disallow

haosouspider

Rule

Path

Disallow

htdig

Rule

Path

Disallow

httpget

Rule

Path

Disallow

huaweisymantecspider

Rule

Path

Disallow

ia_archiver

Rule

Path

Disallow

icjobs

Rule

Path

Disallow

infohelfer

Rule

Path

Disallow

ips-agent

Rule

Path

Disallow

ipsagent

Rule

Path

Disallow

it2media-domain-crawler

Rule

Path

Disallow

java

Rule

Path

Disallow

jobboerse

Rule

Path

Disallow

kaloogabot

Rule

Path

Disallow

komodiabot/1.0

Rule

Path

Disallow

larbin

Rule

Path

Disallow

lb-spider

Rule

Path

Disallow

lex

Rule

Path

Disallow

libwww-perl

Rule

Path

Disallow

linkdex.com

Rule

Path

Disallow

linkpadbot

Rule

Path

Disallow

linkpad

Rule

Path

Disallow

lipperhey

Rule

Path

Disallow

lipperhey seo service

Rule

Path

Disallow

lipperhey-kaus-australis

Rule

Path

Disallow

lipperhey-kaus-australis/5.0

Rule

Path

Disallow

lssrocketcrawler

Rule

Path

Disallow

magpie-crawler

Rule

Path

Disallow

mail.ru_bot

Rule

Path

Disallow

meanpath

Rule

Path

Disallow

meanpathbot

Rule

Path

Disallow

megaindex.ru/2.0

Rule

Path

Disallow

megaindex.ru

Rule

Path

Disallow

megaindex.ru

Rule

Path

Disallow

mia

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

mlbot

Rule

Path

Disallow

msiecrawler

Rule

Path

Disallow

netestate ne crawler

Rule

Path

Disallow

nutch

Rule

Path

Disallow

obot

Rule

Path

Disallow

openindexspider

Rule

Path

Disallow

opidoobot

Rule

Path

Disallow

pagepeeker

Rule

Path

Disallow

picmole

Rule

Path

Disallow

pixray-seeker

Rule

Path

Disallow

psbot

Rule

Path

Disallow

publiclibraryarchive

Rule

Path

Disallow

publiclibraryarchive.org

Rule

Path

Disallow

qualidator*

Rule

Path

Disallow

reverseget

Rule

Path

Disallow

riddler

Rule

Path

Disallow

savetheworldheritage

Rule

Path

Disallow

savetheworldheritage.org

Rule

Path

Disallow

schrein

Rule

Path

Disallow

scooter

Rule

Path

Disallow

scopia

Rule

Path

Disallow

searchmetricsbot

Rule

Path

Disallow

screenerbot

Rule

Path

Disallow

semrushbot

Rule

Path

Disallow

seodiver

Rule

Path

Disallow

seokicks

Rule

Path

Disallow

seokicks-robot

Rule

Path

Disallow

seoscanners.net

Rule

Path

Disallow

seoscanners.net/1

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

sistrix

Rule

Path

Disallow

sistrix

Rule

Path

Disallow

siteexplorer/1.0b

Rule

Path

Disallow

siteexplorer

Rule

Path

Disallow

slysearch

Rule

Path

Disallow

solomonobot

Rule

Path

Disallow

solomonolinkchecker

Rule

Path

Disallow

sosospider

Rule

Path

Disallow

spbot

Rule

Path

Disallow

spiderlytics

Rule

Path

Disallow

ssearch

Rule

Path

Disallow

suggybot

Rule

Path

Disallow

surveybot

Rule

Path

Disallow

swebot

Rule

Path

Disallow

tineye

Rule

Path

Disallow

turnitinbot

Rule

Path

Disallow

twengabot

Rule

Path

Disallow

unister*

Rule

Path

Disallow

unisterbot

Rule

Path

Disallow

updownerbot

Rule

Path

Disallow

waybackarchive.org/1.0

Rule

Path

Disallow

waybackarchive.org

Rule

Path

Disallow

waybackarchive

Rule

Path

Disallow

wbsearchbot

Rule

Path

Disallow

webinator

Rule

Path

Disallow

webliste.ch

Rule

Path

Disallow

webliste

Rule

Path

Disallow

webmastercoffee

Rule

Path

Disallow

webmeup-crawler

Rule

Path

Disallow

webofantbot

Rule

Path

Disallow

wget

Rule

Path

Disallow

worldwebheritage.org

Rule

Path

Disallow

worldwebheritage.org/1.0

Rule

Path

Disallow

worldwebheritage.org/1.1

Rule

Path

Disallow

wotbox

Rule

Path

Disallow

wotbox

Rule

Path

Disallow

wowrack

Rule

Path

Disallow

wowrack

Rule

Path

Disallow

x28-job-bot

Rule

Path

Disallow

xovibot

Rule

Path

Disallow

xovibot/2.0

Rule

Path

Disallow

yacybot

Rule

Path

Disallow

yandexbot/3.0

Rule

Path

Disallow

yandexbot

Rule

Path

Disallow

yandex

Rule

Path

Disallow

yandex.com

Rule

Path

Disallow

yandeximages/3.0

Rule

Path

Disallow

yandeximages

Rule

Path

Disallow

yeti

Rule

Path

Disallow

yeti-mobile

Rule

Path

Disallow

youdaobot

Rule

Path

Disallow

Comments

Files

Warnings

8 invalid lines.

monitorhalterung.derobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

advbot

afilias web mining tool

ahrefsbot

ahrefsbot/3.0

aihitbot

archive.org_bot

backlinkcrawler

baiduspider

baidu

baiduspider+

baiduspider

bdbrandprotect

betabot

bezeqint

blexbot

bpimagewalker*

catchbot

ccbot

cliqzbot

comodo ssl checker

comodo-certificates-spider

content crawler

crazywebcrawler-spider

curl

dcpbot

deusu

discobot

docomo/2.0

domaincrawler

domaincrawler/3.0

dotbot

drupact

ec2linkfinder

edisterbot

exabot

exb language crawler

ezooms

ezooms

findlinks

fr-crawler

gigablastopensource

gigablastopensource/1.0

gluten free crawler

gluten free crawler/1.0

go 1.1 package http

gonzo

gslfbot

haosouspider

htdig

httpget

huaweisymantecspider

ia_archiver

icjobs

infohelfer

ips-agent

ipsagent

it2media-domain-crawler

java

jobboerse

kaloogabot

komodiabot/1.0

larbin

lb-spider

lex

libwww-perl

linkdex.com

linkpadbot

linkpad

lipperhey

lipperhey seo service

lipperhey-kaus-australis

lipperhey-kaus-australis/5.0

lssrocketcrawler

magpie-crawler

monitorhalterung.de
robots.txt