meindl.de
robots.txt

Robots Exclusion Standard data for meindl.de

Archived Snapshots

Resource Scan

Scan Details

Site Domain	meindl.de
Base Domain	meindl.de
Scan Status	Ok
Last Scan	2024-11-01T23:56:32+00:00
Next Scan	2024-12-01T23:56:32+00:00

Last Scan

Scanned	2024-11-01T23:56:32+00:00
URL	https://meindl.de/robots.txt
Domain IPs	104.21.16.246, 172.67.217.83, 2606:4700:3035::6815:10f6, 2606:4700:3037::ac43:d953
Response IP	104.21.16.246
Found	Yes
Hash	3bfcc7e9b75e6a05cba03e9c4dfcbc65b44815d9a33b41b41b3059f7d169e1b5
SimHash	4b60f46f0b33

Groups

*

Rule	Path
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

googlebot

Rule	Path
Allow	/

Rule

Path

Allow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

seoscanners.net

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

seoscanners.net

Rule	Path
Disallow	/

Rule

Path

Disallow

maxthon

Rule	Path
Disallow	/

Rule

Path

Disallow

seamonkey

Rule	Path
Disallow	/

Rule

Path

Disallow

acunetix

Rule	Path
Disallow	/

Rule

Path

Disallow

blackwidow

Rule	Path
Disallow	/

Rule

Path

Disallow

bolt 0

Rule	Path
Disallow	/

Rule

Path

Disallow

bot for jce

Rule	Path
Disallow	/

Rule

Path

Disallow

casper

Rule	Path
Disallow	/

Rule

Path

Disallow

checkprivacy

Rule	Path
Disallow	/

Rule

Path

Disallow

chinaclaw

Rule	Path
Disallow	/

Rule

Path

Disallow

clshttp

Rule	Path
Disallow	/

Rule

Path

Disallow

cmsworldmap

Rule	Path
Disallow	/

Rule

Path

Disallow

comodo

Rule	Path
Disallow	/

Rule

Path

Disallow

custo

Rule	Path
Disallow	/

Rule

Path

Disallow

default browser 0

Rule	Path
Disallow	/

Rule

Path

Disallow

diavol

Rule	Path
Disallow	/

Rule

Path

Disallow

diibot

Rule	Path
Disallow	/

Rule

Path

Disallow

disco

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

download demon

Rule	Path
Disallow	/

Rule

Path

Disallow

ecatch

Rule	Path
Disallow	/

Rule

Path

Disallow

eirgrabber

Rule	Path
Disallow	/

Rule

Path

Disallow

emailcollector

Rule	Path
Disallow	/

Rule

Path

Disallow

emailsiphon

Rule	Path
Disallow	/

Rule

Path

Disallow

emailwolf

Rule	Path
Disallow	/

Rule

Path

Disallow

express webpictures

Rule	Path
Disallow	/

Rule

Path

Disallow

extract

Rule	Path
Disallow	/

Rule

Path

Disallow

extractorpro

Rule	Path
Disallow	/

Rule

Path

Disallow

eyenetie

Rule	Path
Disallow	/

Rule

Path

Disallow

feedfinder

Rule	Path
Disallow	/

Rule

Path

Disallow

fhscan

Rule	Path
Disallow	/

Rule

Path

Disallow

flashget

Rule	Path
Disallow	/

Rule

Path

Disallow

flicky

Rule	Path
Disallow	/

Rule

Path

Disallow

g00g1e

Rule	Path
Disallow	/

Rule

Path

Disallow

getright

Rule	Path
Disallow	/

Rule

Path

Disallow

getweb\!

Rule	Path
Disallow	/

Rule

Path

Disallow

go\!zilla

Rule	Path
Disallow	/

Rule

Path

Disallow

go\-ahead\-got\-it

Rule	Path
Disallow	/

Rule

Path

Disallow

grab

Rule	Path
Disallow	/

Rule

Path

Disallow

grabnet

Rule	Path
Disallow	/

Rule

Path

Disallow

grafula

Rule	Path
Disallow	/

Rule

Path

Disallow

harvest

Rule

Path

Disallow

hmview

Rule

Path

Disallow

ia_archiver

Rule

Path

Disallow

image stripper

Rule

Path

Disallow

image sucker

Rule

Path

Disallow

interget

Rule

Path

Disallow

internet ninja

Rule

Path

Disallow

internetseer\.com

Rule

Path

Disallow

jakarta

Rule

Path

Disallow

java

Rule

Path

Disallow

jetcar

Rule

Path

Disallow

joc web spider

Rule

Path

Disallow

kanagawa

Rule

Path

Disallow

kmccrew

Rule

Path

Disallow

larbin

Rule

Path

Disallow

leechftp

Rule

Path

Disallow

libwww

Rule

Path

Disallow

mass downloader

Rule

Path

Disallow

microsoft\.url

Rule

Path

Disallow

midown tool

Rule

Path

Disallow

miner

Rule

Path

Disallow

mister pix

Rule

Path

Disallow

msfrontpage

Rule

Path

Disallow

navroad

Rule

Path

Disallow

nearsite

Rule

Path

Disallow

net vampire

Rule

Path

Disallow

netants

Rule

Path

Disallow

netspider

Rule

Path

Disallow

netzip

Rule

Path

Disallow

nutch

Rule

Path

Disallow

octopus

Rule

Path

Disallow

offline explorer

Rule

Path

Disallow

offline navigator

Rule

Path

Disallow

pagegrabber

Rule

Path

Disallow

papa foto

Rule

Path

Disallow

pavuk

Rule

Path

Disallow

pcbrowser

Rule

Path

Disallow

peoplepal

Rule

Path

Disallow

planetwork

Rule

Path

Disallow

psbot

Rule

Path

Disallow

purebot

Rule

Path

Disallow

pycurl

Rule

Path

Disallow

realdownload

Rule

Path

Disallow

reget

Rule

Path

Disallow

rippers 0

Rule

Path

Disallow

sitecheck\.internetseer\.com

Rule

Path

Disallow

sitesnagger

Rule

Path

Disallow

skygrid

Rule

Path

Disallow

smartdownload

Rule

Path

Disallow

sucker

Rule

Path

Disallow

superbot

Rule

Path

Disallow

superhttp

Rule

Path

Disallow

surfbot

Rule

Path

Disallow

takeout

Rule

Path

Disallow

teleport pro

Rule

Path

Disallow

toata dragostea mea pentru diavola

Rule

Path

Disallow

turnit

Rule

Path

Disallow

vikspider

Rule

Path

Disallow

voideye

Rule

Path

Disallow

web image collector

Rule

Path

Disallow

web sucker

Rule

Path

Disallow

webauto

Rule

Path

Disallow

webbandit

Rule

Path

Disallow

webcopier

Rule

Path

Disallow

webfetch

Rule

Path

Disallow

webgo is

Rule

Path

Disallow

webleacher

Rule

Path

Disallow

webreaper

Rule

Path

Disallow

websauger

Rule

Path

Disallow

website extractor

Rule

Path

Disallow

website quester

Rule

Path

Disallow

webstripper

Rule

Path

Disallow

webwhacker

Rule

Path

Disallow

webzip

Rule

Path

Disallow

wget

Rule

Path

Disallow

widow

Rule

Path

Disallow

wpscan

Rule

Path

Disallow

www-mechanize

Rule

Path

Disallow

wwwoffle

Rule

Path

Disallow

xaldon webspider

Rule

Path

Disallow

zeus

Rule

Path

Disallow

zmeu

Rule

Path

Disallow

ahrefsbot

Rule

Path

Disallow

cazoodlebot

Rule

Path

Disallow

discobot

Rule

Path

Disallow

easouspider

Rule

Path

Disallow

ecxi

Rule

Path

Disallow

gt\:\:www

Rule

Path

Disallow

heritrix

Rule

Path

Disallow

http\:\:lite

Rule

Path

Disallow

httrack

Rule

Path

Disallow

ia_archiver

Rule

Path

Disallow

id-search

Rule

Path

Disallow

idbot

Rule

Path

Disallow

indy library

Rule

Path

Disallow

irlbot

Rule

Path

Disallow

isc systems irc search 2\.1

Rule

Path

Disallow

linkscrawler

Rule

Path

Disallow

linksmanager\.com_bot

Rule

Path

Disallow

linkwalker

Rule

Path

Disallow

lwp-trivial

Rule

Path

Disallow

mfc_tear_sample

Rule

Path

Disallow

microsoft url control

Rule

Path

Disallow

missigua locator

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

panscient\.com

Rule

Path

Disallow

pecl\:\:http

Rule

Path

Disallow

phpcrawl

Rule

Path

Disallow

pleasecrawl

Rule

Path

Disallow

sbider

Rule

Path

Disallow

searchmetricsbot

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

snoopy

Rule

Path

Disallow

steeler

Rule

Path

Disallow

uri\:\:fetch

Rule

Path

Disallow

urllib

Rule

Path

Disallow

web sucker

Rule

Path

Disallow

webalta

Rule

Path

Disallow

webcollage

Rule

Path

Disallow

wells search ii

Rule

Path

Disallow

wep search

Rule

Path

Disallow

xovibot

Rule

Path

Disallow

yisouspider

Rule

Path

Disallow

zermelo

Rule

Path

Disallow

zyborg

Rule

Path

Disallow

Comments

Good Bot
Bad Bot

Warnings

2 invalid lines.

meindl.derobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

googlebot

ahrefsbot

dotbot

mj12bot

seoscanners.net

seokicks-robot

seoscanners.net

maxthon

seamonkey

acunetix

blackwidow

bolt 0

bot for jce

casper

checkprivacy

chinaclaw

clshttp

cmsworldmap

comodo

custo

default browser 0

diavol

diibot

disco

dotbot

download demon

ecatch

eirgrabber

emailcollector

emailsiphon

emailwolf

express webpictures

extract

extractorpro

eyenetie

feedfinder

fhscan

flashget

flicky

g00g1e

getright

getweb\!

go\!zilla

go\-ahead\-got\-it

grab

grabnet

grafula

harvest

hmview

ia_archiver

image stripper

image sucker

interget

internet ninja

internetseer\.com

jakarta

java

jetcar

joc web spider

kanagawa

kmccrew

larbin

leechftp

libwww

mass downloader

microsoft\.url

midown tool

miner

mister pix

msfrontpage

navroad

nearsite

net vampire

netants

meindl.de
robots.txt