blurb.de
robots.txt

Robots Exclusion Standard data for blurb.de

Resource Scan

Scan Details

Site Domain blurb.de
Base Domain blurb.de
Scan Status Ok
Last Scan2025-11-24T04:58:09+00:00
Next Scan 2025-12-24T04:58:09+00:00

Last Scan

Scanned2025-11-24T04:58:09+00:00
URL https://blurb.de/robots.txt
Redirect https://www.blurb.de/robots.txt
Redirect Domain www.blurb.de
Redirect Base blurb.de
Domain IPs 67.226.216.18
Redirect IPs 67.226.216.18
Response IP 67.226.216.18
Found Yes
Hash 708a09b139724f04785620bd0c9884e00557872fb21819a80c5c7b27dfd89029
SimHash 0b54d8509370

Groups

digext

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 5.0; windows nt; digext; dts agent

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

heritrix/3.3.0

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

metadataparser

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

openlinkprofiler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

id-search

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

test bot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

g-i-g-a-b-o-t

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

s~snapchat-proxy

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

applebot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

baiduspider

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

bingbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

googlebot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

msnbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

naverbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

twitterbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /user/
Allow /tags/*

yandex

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

slurp

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Disallow /user/
Allow /tags/*

*

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Disallow /de/
Disallow /en/
Disallow /en-au/
Disallow /en-ca/
Disallow /en-gb/
Disallow /es/
Disallow /es-us/
Disallow /fr/
Disallow /fr-ca/
Disallow /it/
Disallow /nl/
Disallow /pt/
Disallow /website-v2-test/

Other Records

Field Value
crawl-delay 10

Comments

  • This file is served https://www.blurb.com/robots.txt

Warnings

  • 2 invalid lines.
  • `noindex` is not a known field.