musicstack.com
robots.txt

Robots Exclusion Standard data for musicstack.com

Resource Scan

Scan Details

Site Domain musicstack.com
Base Domain musicstack.com
Scan Status Ok
Last Scan2024-10-12T02:46:48+00:00
Next Scan 2024-10-19T02:46:48+00:00

Last Scan

Scanned2024-10-12T02:46:48+00:00
URL https://musicstack.com/robots.txt
Redirect https://www.musicstack.com/robots.txt
Redirect Domain www.musicstack.com
Redirect Base musicstack.com
Domain IPs 172.66.40.192, 172.66.43.64, 2606:4700:3108::ac42:28c0, 2606:4700:3108::ac42:2b40
Redirect IPs 172.66.40.192, 172.66.43.64, 2606:4700:3108::ac42:28c0, 2606:4700:3108::ac42:2b40
Response IP 172.66.40.192
Found Yes
Hash dd6eab1fe48be0333629264d9ad3c739147866195a0744e045bed77126e05701
SimHash a248dd92b293

Groups

*

Rule Path
Disallow /login/
Disallow /login.cgi*
Disallow /recent/
Disallow /wishlist/
Disallow /watchlist/
Disallow /watchlist.cgi*
Disallow /label/
Disallow /discography/
Disallow /cart/
Disallow /cart/*
Disallow /cart.cgi*
Disallow /contact.cgi*
Disallow /buyer_feedback.cgi*
Disallow /priceguide/
Disallow /pg.cgi*
Disallow /pgt.cgi*
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /*.png$

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

yandex

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.musicstack.com/.sitemap-index.xml