Log In Sign Up

chemnitz-informativ.de
robots.txt

Robots Exclusion Standard data for chemnitz-informativ.de

Resource Scan

Scan Details

Site Domain chemnitz-informativ.de
Base Domain chemnitz-informativ.de
Scan Status Ok
Last Scan2024-11-15T18:47:42+00:00
Next Scan 2024-11-22T18:47:42+00:00

Last Scan

Scanned2024-11-15T18:47:42+00:00
URL https://chemnitz-informativ.de/robots.txt
Redirect https://www.chemnitz-informativ.de/robots.txt
Redirect Domain www.chemnitz-informativ.de
Redirect Base chemnitz-informativ.de
Domain IPs 85.13.155.41
Redirect IPs 85.13.155.41
Response IP 85.13.155.41
Found Yes
Hash f23d570e50dba7dd57926d85ea683106a45abf3a51b8dfeea82e9cc1e7b34fdf
SimHash b23822726cc1

Groups

*

Rule Path
Disallow /agb.php
Disallow /datenschutz.php
Disallow /widerrufsbelehrung.php
Disallow /impressum.html
Disallow /impressum.php
Disallow /impressum
Disallow /datenschutz
Disallow /wp-admin/
Disallow /datenschutzerklaerung
Allow /wp-admin/admin-ajax.php

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

checkmarknetwork/1.0 (+http://www.checkmarknetwork.com/spider.html)

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

svetabot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

xovi

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

search17

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

lb-spider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

htdig

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

picmole

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yeti-mobile

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

netestatenecrawler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

comodosslchecker

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

afiliaswebminingtool

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

bdbrandprotect

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

contentcrawler

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

qualidator

Rule Path
Disallow /

webinator

Rule Path
Disallow /

scooter

Rule Path
Disallow /

thunderstone

Rule Path
Disallow /

larbin

Rule Path
Disallow /

opidoobot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

tineye

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

unister

Rule Path
Disallow /

reverseget

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

nimbostratus

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

adscanner

Rule Path
Disallow /
Disallow /
Disallow /

petalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

colly

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

perl lwp

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

netestate ne crawler (+http://www.website-datenbank.de/)

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

admantx

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /
Back to top

Comments

  • Block Uptime robot
Back to top

Warnings

  • 4 invalid lines.
  • `user agent` is not a known field.
Back to top