zithara.ai
robots.txt

Robots Exclusion Standard data for zithara.ai

Resource Scan

Scan Details

Site Domain zithara.ai
Base Domain zithara.ai
Scan Status Ok
Last Scan2025-07-24T23:03:22+00:00
Next Scan 2025-08-23T23:03:22+00:00

Last Scan

Scanned2025-07-24T23:03:22+00:00
URL https://zithara.ai/robots.txt
Domain IPs 13.35.37.39, 13.35.37.53, 13.35.37.62, 13.35.37.68
Response IP 13.35.37.68
Found Yes
Hash 2e074dafe1782788cedc29628a96d1e929e47781bcbbc77889eab46de01556ec
SimHash 41544840a533

Groups

*

Rule Path
Disallow /_next/static/
Disallow /_next/image/
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://zithara.ai/sitemap.xml
sitemap https://blog.zithara.com/sitemap.xml

Comments

  • Allow Large Language Model Crawlers