Log In Sign Up

endocannabinoidmedicine.com
robots.txt

Robots Exclusion Standard data for endocannabinoidmedicine.com

Resource Scan

Scan Details

Site Domain endocannabinoidmedicine.com
Base Domain endocannabinoidmedicine.com
Scan Status Ok
Last Scan2024-06-12T13:51:01+00:00
Next Scan 2024-06-19T13:51:01+00:00

Last Scan

Scanned2024-06-12T13:51:01+00:00
URL https://www.endocannabinoidmedicine.com/robots.txt
Domain IPs 104.18.22.220, 104.18.23.220, 2606:4700::6812:16dc, 2606:4700::6812:17dc
Response IP 104.18.23.220
Found Yes
Hash 570dd838b02b9450b176d9334999bd2cce26f3cef15558d29cb67993ddedf4ed
SimHash 086ddf329170

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Comments

  • Robots.txt - created by the Virtual Robots.txt WordPress plugin.
  • Source: https://gitlab.com/mikelking/virtual-robots-txt
  • Plugin: https://www.wordpress.org/plugins/virtual-robots-txt/
  • Specifications https://developers.google.com/search/reference/robots_txt
  • VALIDATOR: https://technicalseo.com/seo-tools/robots-txt/
  • Adding disallows for AI bots and users 10/2023
  • Block OpenAI
  • Block Google Bard AI
  • Block Common Crawl
  • Author: Mikel King @ Olivent.com
Back to top