develop.ocregister.com
robots.txt

Groups

*

gptbot

chatgpt-user

ccbot

grapeshot

oai-searchbot

anthropic-ai

claudebot

claude-web

google-extended

applebot-extended

mozilla/5.0 (compatible; newsroom.bi/0.1; +http://www.newsroom.bi/bot.html)

mozilla/5.0 (linux; android 6.0; nexus 5 build/mra51n) applewebkit/537.36 (khtml, like gecko) chrome/87.0.4280.67 mobile safari/537.36 (compatible; mrfcompass-booldog/1.0)

mozilla/5.0 (macintosh; intel mac os x 10_9_2) applewebkit/537.36(khtml, like gecko) chrome/35.0.1916.153 safari/537.36 (compatible; mrfcompass-booldog/1.0)

mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2272.96 mobile safari/537.36 (compatible; mrfcompass-marshall/1.0)

mozilla/5.0 (linux; android 6.0; nexus 5 build/mra51n) applewebkit/537.36 (khtml, like gecko) chrome/87.0.4280.67 mobile safari/537.36 (compatible; mrfcompass-jukebox/1.0)

perplexitybot

amazonbot

facebookbot

ai2bot

docspotbot

mantisbot

thinkbot

grok-crawler

Comments

• Our Content is made available for your personal, non-commercial use subject to our Terms of Service here: https://www.medianewsgroup.com/terms-of-use/
• Any other uses are prohibited, including but not limited to:
• (1) text and data mining activities under Art. 4 of the EU Directive on Copyright in the Digital Single Market;
• (2) use of any Content or information available on the Site for purposes of retrieval augmented generation, grounding, training, or development of machine learning models, algorithms, or artificial intelligence (AI) systems, or to generate substitute content or develop any products, services, or technology;
• (3) caching or archiving the Content; and/or
• (4) any commercial purposes.
• Contact us at https://develop.ocregister.com/contact-us/ for assistance.