minakoe.jp
robots.txt

Robots Exclusion Standard data for minakoe.jp

Resource Scan

Scan Details

Site Domain minakoe.jp
Base Domain minakoe.jp
Scan Status Ok
Last Scan2024-11-14T04:31:19+00:00
Next Scan 2024-11-21T04:31:19+00:00

Last Scan

Scanned2024-11-14T04:31:19+00:00
URL https://minakoe.jp/robots.txt
Domain IPs 94.237.76.64
Response IP 94.237.76.64
Found Yes
Hash 6e02bd122a102519359135ec8153f9685351f0c7837e1db69f02000bc592f61f
SimHash 2060344103e2

Groups

*

Rule Path
Disallow /
Disallow /*.asp
Disallow /latest/%E9%95%B7%E5%B3%B0%E7%91%B3%E4%B8%80%E9%83%8E/
Disallow /latest/%E9%95%B7%E5%B3%B0%20%E7%91%B3%E4%B8%80%E9%83%8E/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E5%B2%90%E9%98%9C%E5%A4%A7%E5%AD%A6/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E9%80%AE%E6%8D%95%20%E7%97%B4%E6%BC%A2/
Disallow /latest/%E5%B2%90%E9%98%9C%E5%A4%A7%E5%AD%A6%20%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E6%80%A7%E5%B7%AE%E5%88%A5/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E5%90%8D%E5%8F%A4%E5%B1%8B%E5%A4%A7%E5%AD%A6%20%E6%80%A7%E5%B7%AE%E5%88%A5/
Disallow /latest/%E6%9D%BE%E5%B0%BE%20%E5%B2%90%E9%98%9C%E5%A4%A7%E5%AD%A6%20%E9%80%AE%E6%8D%95/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E7%97%B4%E6%BC%A2%20%E9%80%AE%E6%8D%95/
Disallow /latest/%E6%9D%BE%E5%B0%BE%20%E5%B2%90%E9%98%9C%E5%A4%A7%E5%AD%A6%20%E9%80%AE%E6%8D%95/

Other Records

Field Value
crawl-delay 600

yahoo! slurp

Rule Path
Allow /
Disallow /*.asp

Other Records

Field Value
crawl-delay 3600

googlebot

Rule Path
Allow /
Disallow /*.asp
Disallow /other_link/2010_07_05_100.html
Disallow /latest/%E9%95%B7%E5%B3%B0%E7%91%B3%E4%B8%80%E9%83%8E/
Disallow /latest/%E9%95%B7%E5%B3%B0%20%E7%91%B3%E4%B8%80%E9%83%8E/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E5%B2%90%E9%98%9C%E5%A4%A7%E5%AD%A6/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E9%80%AE%E6%8D%95%20%E7%97%B4%E6%BC%A2/
Disallow /latest/%E5%B2%90%E9%98%9C%E5%A4%A7%E5%AD%A6%20%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E6%80%A7%E5%B7%AE%E5%88%A5/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E5%90%8D%E5%8F%A4%E5%B1%8B%E5%A4%A7%E5%AD%A6%20%E6%80%A7%E5%B7%AE%E5%88%A5/
Disallow /latest/%E6%9D%BE%E5%B0%BE%20%E5%B2%90%E9%98%9C%E5%A4%A7%E5%AD%A6%20%E9%80%AE%E6%8D%95/
Disallow /latest/%E6%9D%BE%E5%B0%BE%E6%86%B2%E6%9A%81%20%E7%97%B4%E6%BC%A2%20%E9%80%AE%E6%8D%95/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /
Disallow *.asp

Other Records

Field Value
crawl-delay 120

ichiro

Rule Path
Allow /
Disallow /*.asp

Other Records

Field Value
crawl-delay 60

meta-externalagent

Rule Path
Disallow /

msnbot

Rule Path
Allow /
Disallow /*.asp

Other Records

Field Value
crawl-delay 120

y!j-srd/1.0

Rule Path
Allow /
Disallow /*.asp

Other Records

Field Value
crawl-delay 60

y!j-mbs/1.0

Rule Path
Allow /
Disallow /*.asp

Other Records

Field Value
crawl-delay 60

grapeshot

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

crawler

Rule Path
Disallow /

outfoxbot

Rule Path
Disallow /

accelatech rsscrawler

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 3600

becomebot

Rule Path
Disallow /

blogshot

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

rewriterule

Rule Path
Disallow /

steeler

Rule Path
Disallow /

wget

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

hatena

Rule Path
Disallow /

hatena antenna

Rule Path
Disallow /

lwp

Rule Path
Disallow /

yeti

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 3600

mlbot

Rule Path
Disallow /

naver

Rule Path
Disallow /

nhnbot

Rule Path
Disallow /

naverbot-1.0

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

w3c-webcon

Rule Path
Disallow /

website explorer

Rule Path
Disallow /

webox

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

psbot

Rule Path
Disallow /

pockey-gethtml

Rule Path
Disallow /

rss_reader

Rule Path
Disallow /

sakebot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /rsss/

twiceler

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

veoh

Rule Path
Disallow /

webalta

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /