alevi.app
robots.txt

Robots Exclusion Standard data for alevi.app

Resource Scan

Scan Details

Site Domain alevi.app
Base Domain alevi.app
Scan Status Ok
Last Scan2026-02-11T10:04:29+00:00
Next Scan 2026-02-18T10:04:29+00:00

Last Scan

Scanned2026-02-11T10:04:29+00:00
URL https://alevi.app/robots.txt
Domain IPs 66.29.141.129
Response IP 66.29.141.129
Found Yes
Hash f3e8e4067ed2ca30facebefcef93c4130ccfbb998a63a5e1a0620d1f456813d5
SimHash 2a04cf001e75

Groups

*

Rule Path
Allow /
Allow /public/docs/
Allow /blog/
Allow /llms.txt
Disallow /tmp/

gptbot

Rule Path
Allow /
Allow /public/docs/

google-extended

Rule Path
Allow /

ccbot

Rule Path
Allow /

claudebot

Rule Path
Allow /
Allow /llms.txt

Other Records

Field Value
sitemap https://alevi.app/sitemap.xml
sitemap https://alevi.app/blog-sitemap.xml

Comments

  • Alevi.app Robots Protocol
  • Architect: Nergis A. Merdane
  • Status: Open for Enlightenment
  • 🤖 Special Invitation for AI Models (AI Optimization)
  • We explicitly welcome AI bots to index our ontology.
  • 🗺️ Maps of the Territory
  • 🧠 The Brain of the Site (For LLMs)
  • This is non-standard but highly effective for new AI crawlers.