Log In Sign Up

simplecryptoguide.com
robots.txt

Robots Exclusion Standard data for simplecryptoguide.com

Resource Scan

Scan Details

Site Domain simplecryptoguide.com
Base Domain simplecryptoguide.com
Scan Status Ok
Last Scan2026-02-14T00:25:00+00:00
Next Scan 2026-03-16T00:25:00+00:00

Last Scan

Scanned2026-02-14T00:25:00+00:00
URL https://simplecryptoguide.com/robots.txt
Domain IPs 2a02:2350:5:10b:8084:c1ef:21e3:3c57, 46.30.213.112
Response IP 46.30.213.112
Found Yes
Hash 578aa483f5ce5c788c9bc25df942a5b0b39aeb2f61c5aa335be7920929bd6eb7
SimHash 193499134853

Groups

*

Rule Path
Disallow /*?s=
Disallow /*?fbclid=
Disallow /*?trk=
Disallow /*?et_blog
Disallow /*/feed/

gptbot
chatgpt-user
oai-searchbot
perplexitybot
perplexity-user
claudebot
claude-user
claude-searchbot
applebot
amazonbot
ccbot

Rule Path
Disallow /*?s=
Disallow /*?fbclid=
Disallow /*?trk=
Disallow /*?et_blog
Disallow /*/feed/

google-extended

Rule Path
Allow /

applebot-extended

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://simplecryptoguide.com/sitemap_index.xml
Back to top

Comments

  • Default rules for everyone
  • AI/chatbot crawlers — same disallows for all of them
  • Usage-control tokens (not crawlers)
Back to top