craftcms.com
robots.txt

Robots Exclusion Standard data for craftcms.com

Resource Scan

Scan Details

Site Domain craftcms.com
Base Domain craftcms.com
Scan Status Ok
Last Scan2026-02-04T10:48:33+00:00
Next Scan 2026-02-11T10:48:33+00:00

Last Scan

Scanned2026-02-04T10:48:33+00:00
URL https://craftcms.com/robots.txt
Domain IPs 104.17.124.41, 104.17.125.41
Response IP 104.17.124.41
Found Yes
Hash 02188463dcd20a4be74d3022c5158fa83d7537d49873d076f1ecd01cbb88b119
SimHash c07811563f93

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /docs/3.x/fr/
Disallow /index.php/actions/

Other Records

Field Value
sitemap https://craftcms.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://craftcms.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/