climbtothestars.org
robots.txt

Robots Exclusion Standard data for climbtothestars.org

Resource Scan

Scan Details

Site Domain climbtothestars.org
Base Domain climbtothestars.org
Scan Status Ok
Last Scan2025-12-01T19:35:36+00:00
Next Scan 2025-12-02T19:35:36+00:00

Last Scan

Scanned2025-12-01T19:35:36+00:00
URL https://climbtothestars.org/robots.txt
Domain IPs 104.21.69.143, 172.67.209.31, 2606:4700:3030::6815:458f, 2606:4700:3030::ac43:d11f
Response IP 104.21.69.143
Found Yes
Hash e9e49f1ac998cbd903ebb9300a950c49bc4a4c7bbb961920f707d9b4363dd5d4
SimHash 185cf8006173

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • AI BLOCKING
  • Block GPT
  • Block Google Bard
  • Block CommonCrawl https://commoncrawl.org/ccbot
  • END AI BLOCKING