zithara.com
robots.txt

Robots Exclusion Standard data for zithara.com

Resource Scan

Scan Details

Site Domain zithara.com
Base Domain zithara.com
Scan Status Ok
Last Scan2025-08-25T01:33:00+00:00
Next Scan 2025-09-24T01:33:00+00:00

Last Scan

Scanned2025-08-25T01:33:00+00:00
URL https://zithara.com/robots.txt
Redirect https://zithara.ai/robots.txt
Redirect Domain zithara.ai
Redirect Base zithara.ai
Domain IPs 13.35.37.34, 13.35.37.36, 13.35.37.37, 13.35.37.95
Redirect IPs 13.35.37.39, 13.35.37.53, 13.35.37.62, 13.35.37.68
Response IP 13.35.37.62
Found Yes
Hash 2e074dafe1782788cedc29628a96d1e929e47781bcbbc77889eab46de01556ec
SimHash 41544840a533

Groups

*

Rule Path
Disallow /_next/static/
Disallow /_next/image/
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://zithara.ai/sitemap.xml
sitemap https://blog.zithara.com/sitemap.xml

Comments

  • Allow Large Language Model Crawlers