lyricsfrance.com
robots.txt

Robots Exclusion Standard data for lyricsfrance.com

Resource Scan

Scan Details

Site Domain lyricsfrance.com
Base Domain lyricsfrance.com
Scan Status Ok
Last Scan2024-10-05T03:58:20+00:00
Next Scan 2024-10-12T03:58:20+00:00

Last Scan

Scanned2024-10-05T03:58:20+00:00
URL https://lyricsfrance.com/robots.txt
Domain IPs 104.21.70.30, 172.67.218.207, 2606:4700:3030::ac43:dacf, 2606:4700:3037::6815:461e
Response IP 104.21.70.30
Found Yes
Hash 468c0657f6ff1023f756361acb253ab6d5f9f3c62d04b25d621361323c5eb920
SimHash 561e5860fe11

Groups

*
yandex

Rule Path
Disallow /search/
Disallow /system/

yandex
ahrefsbot
amazonbot
semrushbot
dataforseobot
dotbot
barkrowler
petalbot
serendeputybot
mj12bot
netestate
blexbot
seopultcontentanalyzer
ccbot
megaindex
megaindexbot
serpstatbot
zoominfobot
linkfluence
netcraftsurveyagent
geedobot
gptbot
awariorssbot
awariosmartbot
grapeshot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.