kalkey.com
robots.txt

Robots Exclusion Standard data for kalkey.com

Resource Scan

Scan Details

Site Domain kalkey.com
Base Domain kalkey.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-30T10:35:23+00:00
Next Scan 2025-11-06T10:35:23+00:00

Last Successful Scan

Scanned2025-09-29T01:34:32+00:00
URL https://kalkey.com/robots.txt
Domain IPs 2a02:4780:84:824b:37ea:3ef1:9656:46dd, 2a02:4780:84:aa96:85a2:7285:2a44:8d98, 84.32.84.149, 84.32.84.29
Response IP 179.61.189.20
Found Yes
Hash 99c3a4e53150265f5f911e2847c982ba9c56d9dcc54bd17f2db7d4a0ab9ce920
SimHash 4110d5509663

Groups

chatgpt
gptbot
chatgpt-user
oai-search
bard
gemini
oai-searchbot
openai
generativeai
predictiveai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://kalkey.com/sitemap.xml

Comments

  • Allow AI and generative bots with crawl delay