sandraandwoo.com
robots.txt

Robots Exclusion Standard data for sandraandwoo.com

Resource Scan

Scan Details

Site Domain sandraandwoo.com
Base Domain sandraandwoo.com
Scan Status Ok
Last Scan2024-05-23T15:20:48+00:00
Next Scan 2024-05-30T15:20:48+00:00

Last Scan

Scanned2024-05-23T15:20:48+00:00
URL https://sandraandwoo.com/robots.txt
Domain IPs 83.169.31.119
Response IP 83.169.31.119
Found Yes
Hash 0d985a3244431a34c4bd2bac4627c6f6e3c49951cc5e55c8a9cceac889afa12d
SimHash b078bb0e5537

Groups

claudebot

Rule Path
Disallow /scarlet

ccbot

Rule Path
Disallow /scarlet

gptbot

Rule Path
Disallow /scarlet

google-extended

Rule Path
Disallow /scarlet

facebookbot

Rule Path
Disallow /scarlet

omgilibot

Rule Path
Disallow /scarlet

Comments

  • Used for many other (non-commercial) purposes as well
  • For new training only
  • Not for training, only for user requests
  • User-agent: ChatGPT-User
  • Disallow: /scarlet
  • Marker for disabling Bard and Vertex AI
  • Speech synthesis only?
  • Multi-purpose, commercial uses; including LLMs