Log In Sign Up

livebu.com
robots.txt

Robots Exclusion Standard data for livebu.com

Resource Scan

Scan Details

Site Domain livebu.com
Base Domain livebu.com
Scan Status Ok
Last Scan2024-09-28T01:50:30+00:00
Next Scan 2024-10-05T01:50:30+00:00

Last Scan

Scanned2024-09-28T01:50:30+00:00
URL https://livebu.com/robots.txt
Redirect https://www.livebu.com/robots.txt
Redirect Domain www.livebu.com
Redirect Base livebu.com
Domain IPs 133.242.175.188
Redirect IPs 133.242.175.188
Response IP 133.242.175.188
Found Yes
Hash 2437483862758bea40933d0cd0ebf5f0c1823106dfd3e357b7522052c6f4c58f
SimHash 1876d1569593

Groups

facebookexternalhit

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

former

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Disallow /

timpibot

Rule Path
Disallow /

anemone

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

datagnionbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

ias crawler

Rule Path
Disallow /

inguee bot

Rule Path
Disallow /

admantx-apacas

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

daum

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mappy

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

naver

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

steeler

Rule Path
Disallow /

tagoo

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

zanrancrawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

y!j-wsc

Rule Path
Disallow /
Back to top

Warnings

  • 2 invalid lines.
  • `use-agent` is not a known field.
Back to top