cocktaillog.com
robots.txt

Robots Exclusion Standard data for cocktaillog.com

Resource Scan

Scan Details

Site Domain cocktaillog.com
Base Domain cocktaillog.com
Scan Status Ok
Last Scan2026-02-14T02:23:35+00:00
Next Scan 2026-02-21T02:23:35+00:00

Last Scan

Scanned2026-02-14T02:23:35+00:00
URL https://cocktaillog.com/robots.txt
Domain IPs 104.21.74.72, 172.67.156.59, 2606:4700:3030::6815:4a48, 2606:4700:3032::ac43:9c3b
Response IP 104.21.74.72
Found Yes
Hash ccaf404471e5b670d98e197025a8744f8bcba5036b978cedb3d38241c7d4286c
SimHash 6bbb0953d7f4

Groups

ai2bot
amazon-kendra
amazonadbot
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
cohere-ai
deepseek
deepseekbot
diffbot
discordbot
gptbot
google-extended
googleother
googleother-image
googleother-video
grokbot
icc-crawler
imagesiftbot
linguee
mail.ru_bot
mappy
megaindex
meta-externalagent
meta-externalfetcher
mistralbot
oai-searchbot
perplexitybot
smtbot
the knowledge ai
xai-bot
youbot

Product Comment
bytespider robots.txtを無視する
deepseek 念のため追加
xai-bot 念のため追加
Rule Path
Disallow /

heritrix
slack-imgproxy
steeler
tweetmemebot

Rule Path
Disallow /
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://cocktaillog.com/ja/sitemap.xml
sitemap https://cocktaillog.com/en/sitemap.xml

Comments

  • ■■■AIボットをブロック■■■
  • ■■■その他のクローラーをブロック■■■
  • ■■■検索エンジン等がCloudflareの/cdn-cgi/ に誤アクセスする対策■■■