Log In Sign Up

grifftabellen.de
robots.txt

Robots Exclusion Standard data for grifftabellen.de

Resource Scan

Scan Details

Site Domain grifftabellen.de
Base Domain grifftabellen.de
Scan Status Ok
Last Scan2024-11-10T18:41:53+00:00
Next Scan 2024-11-17T18:41:53+00:00

Last Scan

Scanned2024-11-10T18:41:53+00:00
URL http://www.grifftabellen.de/robots.txt
Domain IPs 185.207.106.237
Response IP 185.207.106.237
Found Yes
Hash 18da0215f32556e80476849aa18d69f79958f163e1fe1b805b8489ba709c72d0
SimHash ca3b4151d750

Groups

googlebot

Rule Path
Disallow /author/
Disallow /benachrichtigungen*
Disallow /filter/
Disallow /impressum/
Disallow /kategorien/
Disallow /out/
Disallow /shops/
Disallow /*attachment_id*
Disallow /*?layout=*
Disallow /*?orderby=*
Disallow /?s=*

bingbot

Rule Path
Disallow /author/
Disallow /benachrichtigungen*
Disallow /filter/
Disallow /impressum/
Disallow /kategorien/
Disallow /out/
Disallow /shops/
Disallow /*attachment_id*
Disallow /*?layout=*
Disallow /*?orderby=*
Disallow /?s=*

slurp

Rule Path
Disallow /author/
Disallow /benachrichtigungen*
Disallow /filter/
Disallow /impressum/
Disallow /kategorien/
Disallow /out/
Disallow /shops/
Disallow /*attachment_id*
Disallow /*?layout=*
Disallow /*?orderby=*
Disallow /?s=*

*

Rule Path
Disallow /author/
Disallow /filter/
Disallow /impressum/
Disallow /kategorien/
Disallow /out/
Disallow /shops/

mediapartners-google*

Rule Path
Disallow

aboutusbot

Rule Path
Disallow /

accoona-ai-agent

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

adshadow

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

bloggsi

Rule Path
Disallow /

botonparade

Rule Path
Disallow /

camontspider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

cligoorobot

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

dealgates bot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

envolk

Rule Path
Disallow /

euripbot

Rule Path
Disallow /

eurobot

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

favorstarbot

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

flatlandbot

Rule Path
Disallow /

francis

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

gonzo*

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

hbtronix.spider

Rule Path
Disallow /

henrythemiragorobot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

lapozzbot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

localcombot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

msrbot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nutch

Rule Path
Disallow /

noxtrumbot

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

openacoon

Rule Path
Disallow /

outfoxbot

Rule Path
Disallow /

panelbot

Rule Path
Disallow /

penthesilea

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

rexyobot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

robocrawl spider

Rule Path
Disallow /

robo crawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sapphirewebcrawler

Rule Path
Disallow /

sbider

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seobility

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

sproose

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

taptubot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

urlfan-bot

Rule Path
Disallow /

urlmetriken

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

webalta crawler

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

webwiki

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

whitevector crawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

wwwster

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

yodaoice

Rule Path
Disallow /

zyborg

Rule Path
Disallow /
Back to top

Warnings

  • 2 invalid lines.
Back to top