Log In Sign Up

choco.mint.tailtame.com
robots.txt

Robots Exclusion Standard data for choco.mint.tailtame.com

Resource Scan

Scan Details

Site Domain choco.mint.tailtame.com
Base Domain tailtame.com
Scan Status Ok
Last Scan2025-09-19T20:26:42+00:00
Next Scan 2025-10-19T20:26:42+00:00

Last Scan

Scanned2025-09-19T20:26:42+00:00
URL https://choco.mint.tailtame.com/robots.txt
Domain IPs 202.172.26.15
Response IP 202.172.26.15
Found Yes
Hash 63e82983eede6d62789b6e9790dd71d09e95831ca0aebd2287c990329ddff00e
SimHash 961e5bd146c0

Groups

*

Rule Path
Disallow /
Allow /ads.txt
Allow /ai.txt

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

hatena antenna

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

addsearchbot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

aliyunsecbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

andibot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

anthropicbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

audigentadbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bedrockbot

Rule Path
Disallow /

bedrockbot-uuid

Rule Path
Disallow /

bigsur.ai

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

brightbot 1.0

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt agent

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cloudvertexbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

cotoyogi

Rule Path
Disallow /

crawlspace

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

duckduckgo

Rule Path
Disallow /

exabot

Rule Path
Disallow /

echoboxbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

factset_spyderbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

firecrawlagent

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-firebase

Rule Path
Disallow /

googleother

Rule Path
Disallow /

googleother-image

Rule Path
Disallow /

googleother-video

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

iaskspider/2.0

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

imgproxy

Rule Path
Disallow /

isscyberriskcrawler

Rule Path
Disallow /

jetslide

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

macocu

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

linerbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

mycentralaiscraperbot

Rule Path
Disallow /

naverbot*

Rule Path
Disallow /

ndl-japan

Rule Path
Disallow /

netestate

Rule Path
Disallow /

netseer

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

novaact

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

openai

Rule Path
Disallow /

operator

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

peer39_crawler/1.0

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

panscient

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

poseidon research crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

phindbot

Rule Path
Disallow /

pinterest

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

qualifiedbot

Rule Path
Disallow /

quillbot

Rule Path
Disallow /

quillbot.com

Rule Path
Disallow /

quora-bot

Rule Path
Disallow /

sbintuitionsbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seekrbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seznamhomepagecrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ocob

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

shapbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

smrjbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

speedy

Rule Path
Disallow /

steeler

Rule Path
Disallow /

taragroup intelligent bot

Rule Path
Disallow /

tiktokspider

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

tsolcrawler

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

twingly recon

Rule Path
Disallow /

viennatinybot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

voltron

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wpbot

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandexadditional

Rule Path
Disallow /

yandexadditionalbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://choco.mint.tailtame.com/sitemap.xml
Back to top

Comments

  • GenAI他はここから cnn nytimes などの robots.txt は参考になります。しました！
  • https://www.nytimes.com/robots.txt
  • https://edition.cnn.com/robots.txt
  • https://github.com/ai-robots-txt/ai.robots.txt
  • NO AI training . Do NOT Reupload for my creations.
Back to top

Warnings

  • 4 invalid lines.
Back to top