kilo.ai
robots.txt

Robots Exclusion Standard data for kilo.ai

Resource Scan

Scan Details

Site Domain kilo.ai
Base Domain kilo.ai
Scan Status Ok
Last Scan2026-03-26T11:43:29+00:00
Next Scan 2026-04-09T11:43:29+00:00

Last Scan

Scanned2026-03-26T11:43:29+00:00
URL https://kilo.ai/robots.txt
Domain IPs 216.150.1.1
Response IP 216.150.1.1
Found Yes
Hash 2128951217ffc116b03cbb607a4cb24f7b6a0c4331ea79a5b1dfaf6208d4f787
SimHash 4c2552f2c534

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /admin/
Disallow /worst-site
Allow /landing/copilot
Allow /landing/cursor
Allow /landing/windsurf

Other Records

Field Value
sitemap https://kilo.ai/sitemap.xml
sitemap https://kilo.ai/models/sitemap.xml
sitemap https://kilo.ai/events/sitemap.xml

Comments

  • robots.txt for kilo.ai
  • Sitemaps
  • Disallow admin and API routes
  • Allow all comparison pages
  • Algolia-Crawler-Verif: 1245222E155E7898