Log In Sign Up

last.fm
robots.txt

Robots Exclusion Standard data for last.fm

Resource Scan

Scan Details

Site Domain last.fm
Base Domain last.fm
Scan Status Ok
Last Scan2024-05-10T23:52:58+00:00
Next Scan 2024-05-17T23:52:58+00:00

Last Scan

Scanned2024-05-10T23:52:58+00:00
URL https://last.fm/robots.txt
Redirect https://www.last.fm/robots.txt
Redirect Domain www.last.fm
Redirect Base last.fm
Domain IPs 34.96.123.111
Redirect IPs 199.232.45.188, 2a04:4e42:48::444
Response IP 199.232.45.188
Found Yes
Hash fa059b70a5f9179d84ef3f840f513172230022fed5890dcb0e4bcac7bb066e56
SimHash b5f5f84fa22b

Groups

*

Rule Path
Disallow /music/%2Bnoredirect/
Disallow /de/music/%2Bnoredirect/
Disallow /es/music/%2Bnoredirect/
Disallow /fr/music/%2Bnoredirect/
Disallow /it/music/%2Bnoredirect/
Disallow /ja/music/%2Bnoredirect/
Disallow /pl/music/%2Bnoredirect/
Disallow /pt/music/%2Bnoredirect/
Disallow /ru/music/%2Bnoredirect/
Disallow /sv/music/%2Bnoredirect/
Disallow /tr/music/%2Bnoredirect/
Disallow /zh/music/%2Bnoredirect/
Disallow /user/*/library/music/
Disallow /de/user/*/library/music/
Disallow /es/user/*/library/music/
Disallow /fr/user/*/library/music/
Disallow /it/user/*/library/music/
Disallow /ja/user/*/library/music/
Disallow /pl/user/*/library/music/
Disallow /pt/user/*/library/music/
Disallow /ru/user/*/library/music/
Disallow /sv/user/*/library/music/
Disallow /tr/user/*/library/music/
Disallow /zh/user/*/library/music/
Disallow /user/*/library*
Disallow /de/user/*/library*
Disallow /es/user/*/library*
Disallow /fr/user/*/library*
Disallow /it/user/*/library*
Disallow /ja/user/*/library*
Disallow /pl/user/*/library*
Disallow /pt/user/*/library*
Disallow /ru/user/*/library*
Disallow /sv/user/*/library*
Disallow /tr/user/*/library*
Disallow /zh/user/*/library*
Disallow /*/%2Bwiki/diff
Disallow /search
Disallow /de/search
Disallow /es/search
Disallow /fr/search
Disallow /it/search
Disallow /ja/search
Disallow /pl/search
Disallow /pt/search
Disallow /ru/search
Disallow /sv/search
Disallow /tr/search
Disallow /zh/search
Disallow /forum*
Disallow /de/forum*
Disallow /es/forum*
Disallow /fr/forum*
Disallow /it/forum*
Disallow /ja/forum*
Disallow /pl/forum*
Disallow /pt/forum*
Disallow /ru/forum*
Disallow /sv/forum*
Disallow /tr/forum*
Disallow /zh/forum*
Disallow /label*
Disallow /de/label*
Disallow /es/label*
Disallow /fr/label*
Disallow /it/label*
Disallow /ja/label*
Disallow /pl/label*
Disallow /pt/label*
Disallow /ru/label*
Disallow /sv/label*
Disallow /tr/label*
Disallow /zh/label*
Disallow /group*
Disallow /de/group*
Disallow /es/group*
Disallow /fr/group*
Disallow /it/group*
Disallow /ja/group*
Disallow /pl/group*
Disallow /pt/group*
Disallow /ru/group*
Disallow /sv/group*
Disallow /tr/group*
Disallow /zh/group*
Disallow /user/*/journal*
Disallow /de/user/*/journal*
Disallow /es/user/*/journal*
Disallow /fr/user/*/journal*
Disallow /it/user/*/journal*
Disallow /ja/user/*/journal*
Disallow /pl/user/*/journal*
Disallow /pt/user/*/journal*
Disallow /ru/user/*/journal*
Disallow /sv/user/*/journal*
Disallow /tr/user/*/journal*
Disallow /zh/user/*/journal*
Disallow /event/*/shoutbox?
Disallow /de/event/*/shoutbox?
Disallow /es/event/*/shoutbox?
Disallow /fr/event/*/shoutbox?
Disallow /it/event/*/shoutbox?
Disallow /ja/event/*/shoutbox?
Disallow /pl/event/*/shoutbox?
Disallow /pt/event/*/shoutbox?
Disallow /ru/event/*/shoutbox?
Disallow /sv/event/*/shoutbox?
Disallow /tr/event/*/shoutbox?
Disallow /zh/event/*/shoutbox?
Disallow /event/*/shoutbox/*
Disallow /de/event/*/shoutbox/*
Disallow /es/event/*/shoutbox/*
Disallow /fr/event/*/shoutbox/*
Disallow /it/event/*/shoutbox/*
Disallow /ja/event/*/shoutbox/*
Disallow /pl/event/*/shoutbox/*
Disallow /pt/event/*/shoutbox/*
Disallow /ru/event/*/shoutbox/*
Disallow /sv/event/*/shoutbox/*
Disallow /tr/event/*/shoutbox/*
Disallow /zh/event/*/shoutbox/*
Disallow /festival/*/shoutbox?
Disallow /de/festival/*/shoutbox?
Disallow /es/festival/*/shoutbox?
Disallow /fr/festival/*/shoutbox?
Disallow /it/festival/*/shoutbox?
Disallow /ja/festival/*/shoutbox?
Disallow /pl/festival/*/shoutbox?
Disallow /pt/festival/*/shoutbox?
Disallow /ru/festival/*/shoutbox?
Disallow /sv/festival/*/shoutbox?
Disallow /tr/festival/*/shoutbox?
Disallow /zh/festival/*/shoutbox?
Disallow /festival/*/shoutbox/*
Disallow /de/festival/*/shoutbox/*
Disallow /es/festival/*/shoutbox/*
Disallow /fr/festival/*/shoutbox/*
Disallow /it/festival/*/shoutbox/*
Disallow /ja/festival/*/shoutbox/*
Disallow /pl/festival/*/shoutbox/*
Disallow /pt/festival/*/shoutbox/*
Disallow /ru/festival/*/shoutbox/*
Disallow /sv/festival/*/shoutbox/*
Disallow /tr/festival/*/shoutbox/*
Disallow /zh/festival/*/shoutbox/*
Disallow /tag/*/shoutbox?
Disallow /de/tag/*/shoutbox?
Disallow /es/tag/*/shoutbox?
Disallow /fr/tag/*/shoutbox?
Disallow /it/tag/*/shoutbox?
Disallow /ja/tag/*/shoutbox?
Disallow /pl/tag/*/shoutbox?
Disallow /pt/tag/*/shoutbox?
Disallow /ru/tag/*/shoutbox?
Disallow /sv/tag/*/shoutbox?
Disallow /tr/tag/*/shoutbox?
Disallow /zh/tag/*/shoutbox?
Disallow /tag/*/shoutbox/*
Disallow /de/tag/*/shoutbox/*
Disallow /es/tag/*/shoutbox/*
Disallow /fr/tag/*/shoutbox/*
Disallow /it/tag/*/shoutbox/*
Disallow /ja/tag/*/shoutbox/*
Disallow /pl/tag/*/shoutbox/*
Disallow /pt/tag/*/shoutbox/*
Disallow /ru/tag/*/shoutbox/*
Disallow /sv/tag/*/shoutbox/*
Disallow /tr/tag/*/shoutbox/*
Disallow /zh/tag/*/shoutbox/*
Disallow /user/*/shoutbox?
Disallow /de/user/*/shoutbox?
Disallow /es/user/*/shoutbox?
Disallow /fr/user/*/shoutbox?
Disallow /it/user/*/shoutbox?
Disallow /ja/user/*/shoutbox?
Disallow /pl/user/*/shoutbox?
Disallow /pt/user/*/shoutbox?
Disallow /ru/user/*/shoutbox?
Disallow /sv/user/*/shoutbox?
Disallow /tr/user/*/shoutbox?
Disallow /zh/user/*/shoutbox?
Disallow /user/*/shoutbox/*
Disallow /de/user/*/shoutbox/*
Disallow /es/user/*/shoutbox/*
Disallow /fr/user/*/shoutbox/*
Disallow /it/user/*/shoutbox/*
Disallow /ja/user/*/shoutbox/*
Disallow /pl/user/*/shoutbox/*
Disallow /pt/user/*/shoutbox/*
Disallow /ru/user/*/shoutbox/*
Disallow /sv/user/*/shoutbox/*
Disallow /tr/user/*/shoutbox/*
Disallow /zh/user/*/shoutbox/*
Disallow /music/*/%2Bshoutbox?
Disallow /de/music/*/%2Bshoutbox?
Disallow /es/music/*/%2Bshoutbox?
Disallow /fr/music/*/%2Bshoutbox?
Disallow /it/music/*/%2Bshoutbox?
Disallow /ja/music/*/%2Bshoutbox?
Disallow /pl/music/*/%2Bshoutbox?
Disallow /pt/music/*/%2Bshoutbox?
Disallow /ru/music/*/%2Bshoutbox?
Disallow /sv/music/*/%2Bshoutbox?
Disallow /tr/music/*/%2Bshoutbox?
Disallow /zh/music/*/%2Bshoutbox?
Disallow /music/*/%2Bshoutbox/*
Disallow /de/music/*/%2Bshoutbox/*
Disallow /es/music/*/%2Bshoutbox/*
Disallow /fr/music/*/%2Bshoutbox/*
Disallow /it/music/*/%2Bshoutbox/*
Disallow /ja/music/*/%2Bshoutbox/*
Disallow /pl/music/*/%2Bshoutbox/*
Disallow /pt/music/*/%2Bshoutbox/*
Disallow /ru/music/*/%2Bshoutbox/*
Disallow /sv/music/*/%2Bshoutbox/*
Disallow /tr/music/*/%2Bshoutbox/*
Disallow /zh/music/*/%2Bshoutbox/*
Disallow /music/*/%2Bimages/*/shoutbox?
Disallow /de/music/*/%2Bimages/*/shoutbox?
Disallow /es/music/*/%2Bimages/*/shoutbox?
Disallow /fr/music/*/%2Bimages/*/shoutbox?
Disallow /it/music/*/%2Bimages/*/shoutbox?
Disallow /ja/music/*/%2Bimages/*/shoutbox?
Disallow /pl/music/*/%2Bimages/*/shoutbox?
Disallow /pt/music/*/%2Bimages/*/shoutbox?
Disallow /ru/music/*/%2Bimages/*/shoutbox?
Disallow /sv/music/*/%2Bimages/*/shoutbox?
Disallow /tr/music/*/%2Bimages/*/shoutbox?
Disallow /zh/music/*/%2Bimages/*/shoutbox?
Disallow /music/*/%2Bimages/*/shoutbox/*
Disallow /de/music/*/%2Bimages/*/shoutbox/*
Disallow /es/music/*/%2Bimages/*/shoutbox/*
Disallow /fr/music/*/%2Bimages/*/shoutbox/*
Disallow /it/music/*/%2Bimages/*/shoutbox/*
Disallow /ja/music/*/%2Bimages/*/shoutbox/*
Disallow /pl/music/*/%2Bimages/*/shoutbox/*
Disallow /pt/music/*/%2Bimages/*/shoutbox/*
Disallow /ru/music/*/%2Bimages/*/shoutbox/*
Disallow /sv/music/*/%2Bimages/*/shoutbox/*
Disallow /tr/music/*/%2Bimages/*/shoutbox/*
Disallow /zh/music/*/%2Bimages/*/shoutbox/*
Disallow /music/*/%2Bwiki/shoutbox?
Disallow /de/music/*/%2Bwiki/shoutbox?
Disallow /es/music/*/%2Bwiki/shoutbox?
Disallow /fr/music/*/%2Bwiki/shoutbox?
Disallow /it/music/*/%2Bwiki/shoutbox?
Disallow /ja/music/*/%2Bwiki/shoutbox?
Disallow /pl/music/*/%2Bwiki/shoutbox?
Disallow /pt/music/*/%2Bwiki/shoutbox?
Disallow /ru/music/*/%2Bwiki/shoutbox?
Disallow /sv/music/*/%2Bwiki/shoutbox?
Disallow /tr/music/*/%2Bwiki/shoutbox?
Disallow /zh/music/*/%2Bwiki/shoutbox?
Disallow /music/*/%2Bwiki/shoutbox/*
Disallow /de/music/*/%2Bwiki/shoutbox/*
Disallow /es/music/*/%2Bwiki/shoutbox/*
Disallow /fr/music/*/%2Bwiki/shoutbox/*
Disallow /it/music/*/%2Bwiki/shoutbox/*
Disallow /ja/music/*/%2Bwiki/shoutbox/*
Disallow /pl/music/*/%2Bwiki/shoutbox/*
Disallow /pt/music/*/%2Bwiki/shoutbox/*
Disallow /ru/music/*/%2Bwiki/shoutbox/*
Disallow /sv/music/*/%2Bwiki/shoutbox/*
Disallow /tr/music/*/%2Bwiki/shoutbox/*
Disallow /zh/music/*/%2Bwiki/shoutbox/*
Disallow /music/*/%2Bimages/*
Disallow /de/music/*/%2Bimages/*
Disallow /es/music/*/%2Bimages/*
Disallow /fr/music/*/%2Bimages/*
Disallow /it/music/*/%2Bimages/*
Disallow /ja/music/*/%2Bimages/*
Disallow /pl/music/*/%2Bimages/*
Disallow /pt/music/*/%2Bimages/*
Disallow /ru/music/*/%2Bimages/*
Disallow /sv/music/*/%2Bimages/*
Disallow /tr/music/*/%2Bimages/*
Disallow /zh/music/*/%2Bimages/*
Disallow /search/autocomplete
Disallow /de/search/autocomplete
Disallow /es/search/autocomplete
Disallow /fr/search/autocomplete
Disallow /it/search/autocomplete
Disallow /ja/search/autocomplete
Disallow /pl/search/autocomplete
Disallow /pt/search/autocomplete
Disallow /ru/search/autocomplete
Disallow /sv/search/autocomplete
Disallow /tr/search/autocomplete
Disallow /zh/search/autocomplete
Disallow /player
Disallow /de/player
Disallow /es/player
Disallow /fr/player
Disallow /it/player
Disallow /ja/player
Disallow /pl/player
Disallow /pt/player
Disallow /ru/player
Disallow /sv/player
Disallow /tr/player
Disallow /zh/player
Disallow /features/partial/page-bottom
Disallow /de/features/partial/page-bottom
Disallow /es/features/partial/page-bottom
Disallow /fr/features/partial/page-bottom
Disallow /it/features/partial/page-bottom
Disallow /ja/features/partial/page-bottom
Disallow /pl/features/partial/page-bottom
Disallow /pt/features/partial/page-bottom
Disallow /ru/features/partial/page-bottom
Disallow /sv/features/partial/page-bottom
Disallow /tr/features/partial/page-bottom
Disallow /zh/features/partial/page-bottom
Disallow /features/partial/footer
Disallow /de/features/partial/footer
Disallow /es/features/partial/footer
Disallow /fr/features/partial/footer
Disallow /it/features/partial/footer
Disallow /ja/features/partial/footer
Disallow /pl/features/partial/footer
Disallow /pt/features/partial/footer
Disallow /ru/features/partial/footer
Disallow /sv/features/partial/footer
Disallow /tr/features/partial/footer
Disallow /zh/features/partial/footer
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.last.fm/sitemap-index-secure.xml
Back to top

Comments

  • Stop traversal of user libraries
  • Old pages
  • Shouts
  • N.B: these are not covered by the above /music/ rule
  • (shoutbox vs +shoutbox)
  • AJAX content
Back to top