Log In Sign Up

music-store-download.com
robots.txt

Robots Exclusion Standard data for music-store-download.com

Resource Scan

Scan Details

Site Domain music-store-download.com
Base Domain music-store-download.com
Scan Status Ok
Last Scan2025-05-18T05:59:57+00:00
Next Scan 2025-05-25T05:59:57+00:00

Last Scan

Scanned2025-05-18T05:59:57+00:00
URL https://music-store-download.com/robots.txt
Domain IPs 104.21.72.104, 172.67.181.168, 2606:4700:3035::6815:4868, 2606:4700:3037::ac43:b5a8
Response IP 172.67.181.168
Found Yes
Hash 62e57ab283d792f1e0f0cc637c956f0a8ede04da3e00b9ef20fc171e0894bcaa
SimHash 28440ed0c751

Groups

*

Rule Path
Allow /media/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg
Disallow
Disallow /onepage/
Disallow /checkout/cart/
Disallow /admin/
Disallow /customer/account/forgotpassword/
Disallow /staging/
Disallow /customer/

adsbot-google

Rule Path
Disallow

googlebot

Rule Path
Allow /media/catalog/product/
Allow /media/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg

googlebot-image

Rule Path
Allow /media/
Allow /media/catalog/product/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg

crazywebcrawler-spider

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

trafficbot

Rule Path
Disallow /

trafficbot.live

Rule Path
Disallow /

bingpreview

Rule Path
Allow /media/catalog/product/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg
Back to top

Other Records

Field Value
sitemap https://music-store-download.com/media/google_sitemap_1.xml
sitemap https://music-store-download.com/media/feed/google_shopping_review.xml
sitemap https://music-store-download.com/media/feed/google_shopping.xml
Back to top

Comments

  • Disallow: /catalogsearch/
  • Disallow: /*&q=*
  • Disallow: /directory/currency/*
  • Disallow: /catalog/category/view/s/artist/id/*
  • Disallow: /*.js$
  • Disallow: /*.css$
  • Disallow: /*.php$
  • Disallow: /*?p=*&
  • Disallow: /*?dir*
  • Disallow: /*?mode*
  • Disallow: /*?limit*
  • CSS, JS, Images
  • Sitemap
Back to top