cartha.com
robots.txt

Robots Exclusion Standard data for cartha.com

Resource Scan

Scan Details

Site Domain cartha.com
Base Domain cartha.com
Scan Status Ok
Last Scan2025-10-24T21:12:22+00:00
Next Scan 2025-11-23T21:12:22+00:00

Last Scan

Scanned2025-10-24T21:12:22+00:00
URL https://cartha.com/robots.txt
Domain IPs 108.157.254.104, 108.157.254.25, 108.157.254.31, 108.157.254.37
Response IP 108.157.254.37
Found Yes
Hash 64ad49f270817e1f8ec3b6de25429aa8fbc9fbbe689114a172e2d1a239859d1b
SimHash 4f027ad0c434

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /out/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://cartha.website/sitemap.xml

Comments

  • Robots.txt for Cartha AI
  • https://cartha.website
  • Sitemap location
  • Crawl-delay for respectful crawling