Log In Sign Up

creepydates.org
robots.txt

Robots Exclusion Standard data for creepydates.org

Resource Scan

Scan Details

Site Domain creepydates.org
Base Domain creepydates.org
Scan Status Ok
Last Scan2026-01-27T06:24:26+00:00
Next Scan 2026-02-03T06:24:26+00:00

Last Scan

Scanned2026-01-27T06:24:26+00:00
URL https://creepydates.org/robots.txt
Domain IPs 104.21.90.60, 172.67.196.12, 2606:4700:3034::ac43:c40c, 2606:4700:3035::6815:5a3c
Response IP 172.67.196.12
Found Yes
Hash 2b39635ae87cca2d826471966c971c2d03d10acd2fff80f8da6abbc874802220
SimHash 4d101971ceb0

Groups

*

Rule Path
Allow /
Disallow /_next/

gptbot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

chatgpt-user

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

oai-searchbot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

claude-web

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

anthropic-ai

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

claudebot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

perplexitybot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

deepseekbot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

cohere-ai

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

youbot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

googleother

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

duckassistbot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /

bytespider

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Disallow /
Back to top

Other Records

Field Value
sitemap https://creepydates.org/sitemap.xml
Back to top

Comments

  • *
  • GPTBot
  • ChatGPT-User
  • OAI-SearchBot
  • Claude-Web
  • Anthropic-AI
  • ClaudeBot
  • PerplexityBot
  • DeepseekBot
  • cohere-ai
  • YouBot
  • GoogleOther
  • DuckAssistBot
  • Bytespider
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top