corodomo.com
robots.txt

Robots Exclusion Standard data for corodomo.com

Resource Scan

Scan Details

Site Domain corodomo.com
Base Domain corodomo.com
Scan Status Ok
Last Scan2025-11-21T05:44:50+00:00
Next Scan 2025-11-28T05:44:50+00:00

Last Scan

Scanned2025-11-21T05:44:50+00:00
URL https://corodomo.com/robots.txt
Domain IPs 104.21.23.187, 172.67.212.191, 2606:4700:3034::6815:17bb, 2606:4700:3037::ac43:d4bf
Response IP 104.21.23.187
Found Yes
Hash 2c62186f83bc967fa595d2a2a06d547419aed15399ba8b943833058d6976c527
SimHash e0da5c72ae21

Groups

*

Rule Path
Allow /
Allow /videos/
Allow /learning/
Allow /focus/
Allow /blogs/
Disallow /admin/
Disallow /api/
Disallow /socket/
Disallow /dashboard/
Disallow /profile/
Allow /assets/
Allow /kuromoji/
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.webp
Allow /*.svg
Allow /*.ico

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://corodomo.com/sitemap.xml

Comments

  • Robots.txt for Corodomo - Language Learning Platform
  • Allow all language learning content
  • Disallow admin and API routes
  • Disallow private user areas
  • Allow assets and static files
  • Crawl delay for better server performance
  • Sitemap location