blurb.com
robots.txt

Robots Exclusion Standard data for blurb.com

Resource Scan

Scan Details

Site Domain blurb.com
Base Domain blurb.com
Scan Status Ok
Last Scan2024-06-02T11:21:53+00:00
Next Scan 2024-07-02T11:21:53+00:00

Last Scan

Scanned2024-06-02T11:21:53+00:00
URL https://blurb.com/robots.txt
Redirect https://www.blurb.com/robots.txt
Redirect Domain www.blurb.com
Redirect Base blurb.com
Domain IPs 67.226.216.15
Redirect IPs 67.226.216.15
Response IP 67.226.216.15
Found Yes
Hash 5dbf43a69e5e48eed8cbf12863a7c99ce1697d7fbb2ec6270cdd31d914687847
SimHash 0a7dd8501370

Groups

digext

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 5.0; windows nt; digext; dts agent

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

heritrix/3.3.0

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

metadataparser

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

openlinkprofiler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

id-search

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

test bot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

g-i-g-a-b-o-t

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

s~snapchat-proxy

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

applebot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

baiduspider

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

bingbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

googlebot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

msnbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

naverbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

twitterbot

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /user/
Allow /tags/*

yandex

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Allow /tags/*

slurp

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*
Disallow /user/
Allow /tags/*

*

Rule Path
Disallow /my/
Disallow /admin/
Disallow /status/
Disallow /feeds/search*
Disallow /bookstore/search*
Disallow /*.swf$
Disallow /bookshow/cache/
Disallow /feeds/user*
Disallow /ebooks/editor.html
Disallow /ebooks/reader.html
Disallow /ebook-creator/editor.html
Disallow /node/*
Disallow /bookstore/invited/*
Disallow /distribution/*
Disallow /search/*

Other Records

Field Value
crawl-delay 10

semrushbot-sa

Rule Path
Disallow /

Comments

  • This file is served https://www.blurb.com/robots.txt

Warnings

  • 2 invalid lines.
  • `noindex` is not a known field.