Log In Sign Up

ekhool.com
robots.txt

Robots Exclusion Standard data for ekhool.com

Resource Scan

Scan Details

Site Domain ekhool.com
Base Domain ekhool.com
Scan Status Ok
Last Scan2026-01-09T23:36:13+00:00
Next Scan 2026-02-08T23:36:13+00:00

Last Scan

Scanned2026-01-09T23:36:13+00:00
URL https://ekhool.com/robots.txt
Domain IPs 13.235.160.198, 3.110.26.30, 3.111.128.156
Response IP 3.110.26.30
Found Yes
Hash 46a83b7231e2a7be3763d0b8697799f46f17a4ad94750fb97154605264aac098
SimHash 6412ba62c4d1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /includes/
Disallow /common/
Disallow /scss/

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

ai-crawler

Rule Path
Allow /

xai-bot

Rule Path
Allow /

bytespider

Rule Path
Allow /

youchatbot

Rule Path
Allow /

neevabot

Rule Path
Allow /

openai

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandex

Rule Path
Allow /

sogou

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

applebot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://ekhool.com/sitemap.xml
Back to top

Comments

  • robots.txt generated by ekhool.com
  • ------------------------------
  • General rules for all crawlers
  • ------------------------------
  • ------------------------------
  • Allow AI bots (already allowed, but kept for clarity)
  • ------------------------------
  • Allow major search engines (optional because * already allows)
  • ------------------------------
  • Sitemap
  • ------------------------------
Back to top