Log In Sign Up

yoyaku.io
robots.txt

Robots Exclusion Standard data for yoyaku.io

Resource Scan

Scan Details

Site Domain yoyaku.io
Base Domain yoyaku.io
Scan Status Ok
Last Scan2025-10-12T10:21:59+00:00
Next Scan 2025-11-11T10:21:59+00:00

Last Scan

Scanned2025-10-12T10:21:59+00:00
URL https://yoyaku.io/robots.txt
Domain IPs 172.66.40.199, 172.66.43.57, 2606:4700:3108::ac42:28c7, 2606:4700:3108::ac42:2b39
Response IP 172.66.43.57
Found Yes
Hash 96111c0811ffd0eb8fdd297aa1cc10ccf6c4693b0890063392203c906ca0a760
SimHash 68891251a2f2

Groups

googlebot

Rule Path
Allow /

googleother

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Allow /

openai-searchbot

Rule Path
Allow /

musicbot

Rule Path
Allow /

discogscrawler

Rule Path
Allow /

bandcampbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 20

mj12bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

dotbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /checkout/
Disallow /cart/
Disallow /myaccount/
Disallow /*?add-to-cart=*
Disallow /*?removed_item=*
Allow /wp-content/uploads/
Allow /wp-content/themes/*/assets/

bytespider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

whatsapp

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://yoyaku.io/sitemap_index.xml
Back to top

Comments

  • YOYAKU.IO Robots.txt - Optimized for Music Domain 2025-08-24
  • ALLOWED BOTS - Useful for music domain
  • Social Media Bots - Allowed for sharing
  • SEO & Analytics Bots - Allowed for insights
  • DEFAULT - All other bots with restrictions
  • Disallow admin and system pages
  • Disallow e-commerce pages
  • Allow important directories
  • BLOCKED BOTS - Only resource intensive without value
  • Crawl delays for heavy bots
  • Sitemap
Back to top