musicnotesbox.com
robots.txt

Robots Exclusion Standard data for musicnotesbox.com

Resource Scan

Scan Details

Site Domain musicnotesbox.com
Base Domain musicnotesbox.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/10/2025, 3:09:05 AM
Next Scan 6/17/2025, 3:09:05 AM

Last Successful Scan

Scanned6/2/2025, 3:08:33 AM
URL https://musicnotesbox.com/robots.txt
Domain IPs 104.21.3.180, 172.67.153.152, 2606:4700:3032::6815:3b4, 2606:4700:3036::ac43:9998
Response IP 104.21.3.180
Found Yes
Hash 25cdac498f24fa8d8a8b3aaec6562535f912e0f22dbc0fbce621056d8235fc03
SimHash 28441c80db91

Groups

*

Rule Path
Disallow /onepage/
Disallow /checkout/cart/
Disallow /admin/
Disallow /catalogsearch/result/
Disallow /*%26q%3D*
Disallow /*?limit=all
Disallow /customer/account/forgotpassword/
Disallow /directory/currency/*

adsbot-google

Rule Path
Disallow

googlebot

Rule Path
Allow /media/catalog/product/
Allow /media/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg

googlebot-image

Rule Path
Allow /media/
Allow /media/catalog/product/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg

*

Rule Path
Allow /media/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg

crazywebcrawler-spider

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

trafficbot

Rule Path
Disallow /

trafficbot.live

Rule Path
Disallow /

bingpreview

Rule Path
Allow /media/
Allow /media/catalog/product/
Allow /*.css$
Allow /*.css?
Allow /*.js$
Allow /*.js?
Allow /*.gif
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.svg

crazywebcrawler-spider

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://musicnotesbox.com/media/google_sitemap_1.xml
sitemap https://musicnotesbox.com/sitemap.xml
sitemap https://musicnotesbox.com/media/feed/google_shopping2.xml
sitemap https://musicnotesbox.com/media/feed/google_shopping_reivew2.xml

Comments

  • Disallow: /media/feed/
  • Disallow: /catalogsearch/
  • CSS, JS, Images
  • CSS, JS, Images
  • CSS, JS, Images
  • CSS, JS, Images