lyricsvault.info
robots.txt

Robots Exclusion Standard data for lyricsvault.info

Archived Snapshots

Resource Scan

Scan Details

Site Domain	lyricsvault.info
Base Domain	lyricsvault.info
Scan Status	Ok
Last Scan	2024-11-02T17:03:45+00:00
Next Scan	2024-11-09T17:03:45+00:00

Last Scan

Scanned	2024-11-02T17:03:45+00:00
URL	https://lyricsvault.info/robots.txt
Redirect	https://www.lyricsvault.net/robots.txt
Redirect Domain	www.lyricsvault.net
Redirect Base	lyricsvault.net
Domain IPs	185.104.29.78, 2a06:2ec0:1::117
Redirect IPs	185.104.29.78, 2a06:2ec0:1::117
Response IP	185.104.29.78
Found	Yes
Hash	3831f5a7f681542d81365ea62ff3a2e5fb3018ed731bf397a44f69d2a72d1da6
SimHash	b39252030ea2

Groups

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

a6-indexer

Rule	Path
Disallow	/

Rule

Path

Disallow

accelobot

Rule	Path
Disallow	/

Rule

Path

Disallow

acoon

Rule	Path
Disallow	/

Rule

Path

Disallow

viglink

Rule	Path
Disallow	/

Rule

Path

Disallow

admantx

Rule	Path
Disallow	/

Rule

Path

Disallow

advbot

Rule	Path
Disallow	/

Rule

Path

Disallow

affectv

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

apptusbot

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

atomic_email_hunter

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

beholderbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bender

Rule	Path
Disallow	/

Rule

Path

Disallow

betabot

Rule	Path
Disallow	/

Rule

Path

Disallow

safesearch microdata crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

birubot

Rule	Path
Disallow	/

Rule

Path

Disallow

bixolabs

Rule	Path
Disallow	/

Rule

Path

Disallow

blekkobot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blogpulselive

Rule	Path
Disallow	/

Rule

Path

Disallow

botw spider

Rule	Path
Disallow	/

Rule

Path

Disallow

businessdbbot

Rule	Path
Disallow	/

Rule

Path

Disallow

butterfly

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

coccoc

Rule	Path
Disallow	/

Rule

Path

Disallow

crazywebcrawler-spider

Rule	Path
Disallow	/

Rule

Path

Disallow

crowsnest

Rule	Path
Disallow	/

Rule

Path

Disallow

crystalsemanticsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataprovider site explorer

Rule	Path
Disallow	/

Rule

Path

Disallow

daumoa

Rule	Path
Disallow	/

Rule

Path

Disallow

dazoobot

Rule	Path
Disallow	/

Rule

Path

Disallow

discobot

Rule	Path
Disallow	/

Rule

Path

Disallow

discoverybot

Rule	Path
Disallow	/

Rule

Path

Disallow

doc

Rule	Path
Disallow	/

Rule

Path

Disallow

docomo

Rule	Path
Disallow	/

Rule

Path

Disallow

docomo/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

domainappender

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

download ninja

Rule	Path
Disallow	/

Rule

Path

Disallow

duckduckgo-favicons-bot

Rule	Path
Disallow	/

Rule

Path

Disallow

easou

Rule	Path
Disallow	/

Rule

Path

Disallow

easouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

envolk

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

expo9

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule

Path

Disallow

ezooms

Rule

Path

Disallow

facebot

Rule

Path

Disallow

fairshare

Rule

Path

Disallow

feedlybot

Rule

Path

Disallow

feedtrace

Rule

Path

Disallow

fetch

Rule

Path

Disallow

findlinks

Rule

Path

Disallow

flatlandbot

Rule

Path

Disallow

flipboard

Rule

Path

Disallow

flipboardproxy

Rule

Path

Disallow

genieo

Rule

Path

Disallow

genieo/1.0

Rule

Path

Disallow

germcrawler

Rule

Path

Disallow

gigabit

Rule

Path

Disallow

gimme60bot

Rule

Path

Disallow

gimmie60

Rule

Path

Disallow

ginxbot

Rule

Path

Disallow

gooblogsearch/2.0

Rule

Path

Disallow

gosospider

Rule

Path

Disallow

grapeshot

Rule

Path

Disallow

grapeshotcrawler

Rule

Path

Disallow

great-plains-web-spider

Rule

Path

Disallow

grub
grub-client

Rule

Path

Disallow

heritrix

Rule

Path

Disallow

holmes

Rule

Path

Disallow

httrack

Rule

Path

Disallow

huaweisymantecspider

Rule

Path

Disallow

ia_archiver

Rule

Path

Disallow

ichiro

Rule

Path

Disallow

influencebo

Rule

Path

Disallow

integromedb

Rule

Path

Disallow

istellabot

Rule

Path

Disallow

itsapic.com_crawler

Rule

Path

Disallow

jikespider

Rule

Path

Disallow

k2spider

Rule

Path

Disallow

kalooga

Rule

Path

Disallow

kaloogabot

Rule

Path

Disallow

knowaboutbot

Rule

Path

Disallow

kraken

Rule

Path

Disallow

kraken/0.1

Rule

Path

Disallow

larbin

Rule

Path

Disallow

lexxebot

Rule

Path

Disallow

libwww

Rule

Path

Disallow

linguee

Rule

Path

Disallow

linkdexbot

Rule

Path

Disallow

linko

Rule

Path

Disallow

linkpadbot

Rule

Path

Disallow

loadtimebot

Rule

Path

Disallow

lynnbot

Rule

Path

Disallow

magpie-crawler

Rule

Path

Disallow

magpie-crawler/1.1

Rule

Path

Disallow

mail.ru

Rule

Path

Disallow

mail.ru_bot

Rule

Path

Disallow

maxpoint.crawler

Rule

Path

Disallow

maxpointcrawler

Rule

Path

Disallow

maxpointcrawler/nutch-1.1

Rule

Path

Disallow

meanpathbot

Rule

Path

Disallow

mediapartners-google

Rule

Path

Disallow

megaindex

Rule

Path

Disallow

meltwater

Rule

Path

Disallow

memorybot

Rule

Path

Disallow

metauri

Rule

Path

Disallow

microsoft.url.control

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

mlbot

Rule

Path

Disallow

moget

Rule

Path

Disallow

mojeekbot

Rule

Path

Disallow

moreover

Rule

Path

Disallow

moreoverbot

Rule

Path

Disallow

msiecrawler

Rule

Path

Disallow

musobot

Rule

Path

Disallow

mxbot

Rule

Path

Disallow

my6sense

Rule

Path

Disallow

my-robot

Rule

Path

Disallow

naverbot

Rule

Path

Disallow

nbot

Rule

Path

Disallow

ncbot

Rule

Path

Disallow

nerdbynature

Rule

Path

Disallow

nerdbynature.bot

Rule

Path

Disallow

netseer

Rule

Path

Disallow

netseer

Rule

Path

Disallow

newsnow

Rule

Path

Disallow

nextgensearchbot

Rule

Path

Disallow

nhn corp

Rule

Path

Disallow

njuicebot

Rule

Path

Disallow

npbot

Rule

Path

Disallow

nutch

Rule

Path

Disallow

nutch-1.1

Rule

Path

Disallow

nutch-1.6

Rule

Path

Disallow

obot

Rule

Path

Disallow

ocelli

Rule

Path

Disallow

offline explorer

Rule

Path

Disallow

omgili

Rule

Path

Disallow

oneriot

Rule

Path

Disallow

onetszukaj

Rule

Path

Disallow

openwebindex

Rule

Path

Disallow

openwebindex/nutch-1.6

Rule

Path

Disallow

pagepeeker

Rule

Path

Disallow

pagesinventory

Rule

Path

Disallow

percbotspider

Rule

Path

Disallow

proximic

Rule

Path

Disallow

psbot

Rule

Path

Disallow

ptd-crawler

Rule

Path

Disallow

purebot

Rule

Path

Disallow

python-urllib

Rule

Path

Disallow

r6_commentreader

Rule

Path

Disallow

r6_feedfetcher

Rule

Path

Disallow

radian6

Rule

Path

Disallow

radian6_default

Rule

Path

Disallow

sbider

Rule

Path

Disallow

scoutjet

Rule

Path

Disallow

searchmetricsbot

Rule

Path

Disallow

semalt

Rule

Path

Disallow

semiocast

Rule

Path

Disallow

semrushbot

Rule

Path

Disallow

seodat

Rule

Path

Disallow

seokicks-robot

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

seznambot/3.0

Rule

Path

Disallow

shopwiki

Rule

Path

Disallow

showyoubot

Rule

Path

Disallow

sistrix

Rule

Path

Disallow

sistrixcrawler

Rule

Path

Disallow

sitebot

Rule

Path

Disallow

sitecheck.internetseer.com

Rule

Path

Disallow

siteintel

Rule

Path

Disallow

sitesnagger

Rule

Path

Disallow

skimbot

Rule

Path

Disallow

skimwordsbot

Rule

Path

Disallow

sogou

Rule

Path

Disallow

sogou spider

Rule

Path

Disallow

sosospider

Rule

Path

Disallow

spbot

Rule

Path

Disallow

speedy

Rule

Path

Disallow

spinn3r

Rule

Path

Disallow

sproose

Rule

Path

Disallow

steeler

Rule

Path

Disallow

suggybot

Rule

Path

Disallow

summify

Rule

Path

Disallow

taboolabot

Rule

Path

Disallow

tagoobot

Rule

Path

Disallow

tanner

Rule

Path

Disallow

teleport

Rule

Path

Disallow

teleportpro

Rule

Path

Disallow

teoma

Rule

Path

Disallow

thingfetcher

Rule

Path

Disallow

tineye

Rule

Path

Disallow

trendictionbot

Rule

Path

Disallow

trovitbot

Rule

Path

Disallow

turnitinbot

Rule

Path

Disallow

tweetedtimes bot

Rule

Path

Disallow

tweetmemebot

Rule

Path

Disallow

twiceler

Rule

Path

Disallow

twingly recon

Rule

Path

Disallow

twitmatic

Rule

Path

Disallow

twitterbot

Rule

Path

Disallow

twitturly

Rule

Path

Disallow

typhoeus

Rule

Path

Disallow

ubicrawler

Rule

Path

Disallow

umbot

Rule

Path

Disallow

umbot-ln

Rule

Path

Disallow

vagabondo

Rule

Path

Disallow

verticalman

Rule

Path

Disallow

viralheat

Rule

Path

Disallow

voilabot

Rule

Path

Disallow

voltron

Rule

Path

Disallow

wakamecrawler/0.01

Rule

Path

Disallow

wbsearchbot

Rule

Path

Disallow

webalta

Rule

Path

Disallow

webcopier

Rule

Path

Disallow

webmastercoffee

Rule

Path

Disallow

webreaper

Rule

Path

Disallow

webstripper

Rule

Path

Disallow

webvac

Rule

Path

Disallow

webzip

Rule

Path

Disallow

wesee

Rule

Path

Disallow

wget

Rule

Path

Disallow

wikiwix-bot-3.0

Rule

Path

Disallow

wotbox

Rule

Path

Disallow

www.integromedb.org/crawler

Rule

Path

Disallow

xenu

Rule

Path

Disallow

xovibot

Rule

Path

Disallow

xyzbot

Rule

Path

Disallow

yacybot

Rule

Path

Disallow

yahoo pipes 2.0

Rule

Path

Disallow

yamanalab-robot

Rule

Path

Disallow

yandex

Rule

Path

Disallow

yanga

Rule

Path

Disallow

yeti

Rule

Path

Disallow

yetibot

Rule

Path

Disallow

yioopbot

Rule

Path

Disallow

youdaobot

Rule

Path

Disallow

zao

Rule

Path

Disallow

zealbot

Rule

Path

Disallow

zumbot/1.0

Rule

Path

Disallow

zyborg

Rule

Path

Disallow

Warnings

6 invalid lines.

lyricsvault.inforobots.txt

Resource Scan

Scan Details

Last Scan

Groups

cliqzbot

a6-indexer

accelobot

acoon

viglink

admantx

advbot

affectv

ahrefsbot

apptusbot

archive.org_bot

atomic_email_hunter

baiduspider

beholderbot

bender

betabot

safesearch microdata crawler

birubot

bixolabs

blekkobot

blexbot

blogpulselive

botw spider

businessdbbot

butterfly

ccbot

ccbot

coccoc

crazywebcrawler-spider

crowsnest

crystalsemanticsbot

dataprovider site explorer

daumoa

dazoobot

discobot

discoverybot

doc

docomo

docomo/2.0

domainappender

dotbot

download ninja

duckduckgo-favicons-bot

easou

easouspider

envolk

exabot

expo9

ezooms

ezooms

facebot

fairshare

feedlybot

feedtrace

fetch

findlinks

flatlandbot

flipboard

flipboardproxy

genieo

genieo/1.0

germcrawler

gigabit

gimme60bot

gimmie60

ginxbot

gooblogsearch/2.0

gosospider

grapeshot

grapeshotcrawler

great-plains-web-spider

grubgrub-client

heritrix

holmes

httrack

lyricsvault.info
robots.txt

grub
grub-client