monmon-games.com
robots.txt

Robots Exclusion Standard data for monmon-games.com

Resource Scan

Scan Details

Site Domain monmon-games.com
Base Domain monmon-games.com
Scan Status Ok
Last Scan2025-12-23T01:14:40+00:00
Next Scan 2025-12-30T01:14:40+00:00

Last Scan

Scanned2025-12-23T01:14:40+00:00
URL https://monmon-games.com/robots.txt
Domain IPs 85.131.197.49
Response IP 85.131.197.49
Found Yes
Hash 4b45fe44905a5dea423478e874de460bca8af8496f9c51b824c450591452985c
SimHash fb17d2d28155

Groups

gptbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

dataforseo

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

kagibot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

vectarabot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mwmblbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

siteexplorer.info

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

databot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

gptbot-*

Rule Path
Disallow /

*

Rule Path
Allow /

Comments

  • --- AI学習系クローラーのアクセス拒否 ---
  • OpenAI / ChatGPT
  • Google Bard / Gemini
  • Anthropic Claude
  • Common Crawl
  • Meta / Facebook
  • ByteDance(TikTokç³»AI)
  • Diffbot
  • DataForSEO
  • Amazon / Alexa AI
  • Kagi Search
  • Applebot(Apple AI)
  • Perplexity AI
  • You.com
  • Neeva
  • Vectara
  • CoHere
  • Sogou / Chinese AI
  • Yandex AI
  • Mwmbl
  • ChatGPT Plugins 用スクレイピング対策
  • その他クローラー
  • --- 通常検索エンジンは許可 ---