sakuhindb.com
robots.txt

Robots Exclusion Standard data for sakuhindb.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	sakuhindb.com
Base Domain	sakuhindb.com
Scan Status	Ok
Last Scan	2024-11-07T13:57:33+00:00
Next Scan	2024-11-14T13:57:33+00:00

Last Scan

Scanned	2024-11-07T13:57:33+00:00
URL	https://sakuhindb.com/robots.txt
Domain IPs	34.201.231.97, 54.175.17.31
Response IP	34.201.231.97
Found	Yes
Hash	573b753ff19e13ffb17c8d9817cd42ced55e34e7ebc7ad622687977f48f94446
SimHash	02c4357b80a2

Groups

accelatech rsscrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

adsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

adscanner

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

aihitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

aipbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinkcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduimagespider

Rule	Path
Disallow	/

Rule

Path

Disallow

baidumobaider

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider+

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

becomebot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blogshot

Rule	Path
Disallow	/

Rule

Path

Disallow

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

buck

Rule	Path
Disallow	/

Rule

Path

Disallow

careerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

checkmarknetwork

Rule	Path
Disallow	/

Rule

Path

Disallow

cincraw

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

cloudservermarketspider

Rule	Path
Disallow	/

Rule

Path

Disallow

coccoc

Rule	Path
Disallow	/

Rule

Path

Disallow

cohere-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

crawler4j

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

daumoa

Rule	Path
Disallow	/

Rule

Path

Disallow

df

Rule	Path
Disallow	/

Rule

Path

Disallow

df bot

Rule	Path
Disallow	/

Rule

Path

Disallow

domain re-animator bot

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

domainstatsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

download ninja

Rule	Path
Disallow	/

Rule

Path

Disallow

e-societyrobot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookbot

Rule	Path
Disallow	/

Rule

Path

Disallow

fr-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

garlikcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

gosign-security-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshot

Rule

Path

Disallow

haosouspider

Rule

Path

Disallow

hatena

Rule

Path

Disallow

hatena antenna

Rule

Path

Disallow

i-market-bot

Rule

Path

Disallow

iccrawler

Rule

Path

Disallow

implisensebot

Rule

Path

Disallow

indeedbot

Rule

Path

Disallow

inetdex-bot

Rule

Path

Disallow

irlbot

Rule

Path

Disallow

jobboersebot

Rule

Path

Disallow

jobs.de-robot

Rule

Path

Disallow

just-crawler

Rule

Path

Disallow

kraken

Rule

Path

Disallow

kyoto-crawler

Rule

Path

Disallow

linguee

Rule

Path

Disallow

linkstats

Rule

Path

Disallow

lipperhey-kaus-australis

Rule

Path

Disallow

ltx71

Rule

Path

Disallow

lwp

Rule

Path

Disallow

magpie-crawler

Rule

Path

Disallow

meanpathbot

Rule

Path

Disallow

megaindex.com

Rule

Path

Disallow

megaindex.ru

Rule

Path

Disallow

meta-externalagent

Rule

Path

Disallow

metajobbot

Rule

Path

Disallow

mindupbot

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

mlbot

Rule

Path

Disallow

naver

Rule

Path

Disallow

naverbot

Rule

Path

Disallow

naverbot-1.0

Rule

Path

Disallow

netestate

Rule

Path

Disallow

nhnbot

Rule

Path

Disallow

obot

Rule

Path

Disallow

omgili

Rule

Path

Disallow

omgilibot

Rule

Path

Disallow

openhosebot

Rule

Path

Disallow

outfoxbot

Rule

Path

Disallow

petalbot

Rule

Path

Disallow

plista

Rule

Path

Disallow

plukkie

Rule

Path

Disallow

pockey-gethtml

Rule

Path

Disallow

psbot

Rule

Path

Disallow

python/3.5 aiohttp

Rule

Path

Disallow

qwantify

Rule

Path

Disallow

r6_commentreader

Rule

Path

Disallow

rewriterule

Rule

Path

Disallow

rogerbot

Rule

Path

Disallow

rss_reader

Rule

Path

Disallow

sabsimbot

Rule

Path

Disallow

safednsbot

Rule

Path

Disallow

sakebot

Rule

Path

Disallow

screaming frog seo spider

Rule

Path

Disallow

searchmetricsbot

Rule

Path

Disallow

seekportbot

Rule

Path

Disallow

semrushbot-sa

Rule

Path

Disallow

sentibot

Rule

Path

Disallow

sentibot

Rule

Path

Disallow

seodiver

Rule

Path

Disallow

seokicks-robot

Rule

Path

Disallow

seoscanners.net

Rule

Path

Disallow

serendeputybot

Rule

Path

Disallow

serpstatbot

Rule

Path

Disallow

sg-orbiter

Rule

Path

Disallow

sidetrade

Rule

Path

Disallow

sistrix

Rule

Path

Disallow

sistrix

Rule

Path

Disallow

sistrix crawler

Rule

Path

Disallow

siteliner

Rule

Path

Disallow

spbot

Rule

Path

Disallow

spiderbot

Rule

Path

Disallow

startmebot

Rule

Path

Disallow

steeler

Rule

Path

Disallow

surveybot

Rule

Path

Disallow

t3versionsbot

Rule

Path

Disallow

thumbsniper

Rule

Path

Disallow

toweya.com

Rule

Path

Disallow

trendictionbot

Rule

Path

Disallow

turnitinbot

Rule

Path

Disallow

um-ic

Rule

Path

Disallow

unisterbot

Rule

Path

Disallow

velenpublicwebcrawler

Rule

Path

Disallow

veoh

Rule

Path

Disallow

voyager

Rule

Path

Disallow

w3c-webcon

Rule

Path

Disallow

wbsearchbot

Rule

Path

Disallow

webalta

Rule

Path

Disallow

webauto

Rule

Path

Disallow

webfetch

Rule

Path

Disallow

webox

Rule

Path

Disallow

website explorer

Rule

Path

Disallow

wget

Rule

Path

Disallow

wotbox

Rule

Path

Disallow

ws-bot-v1

Rule

Path

Disallow

xing

Rule

Path

Disallow

xing bot

Rule

Path

Disallow

yahoo! slurp

Rule

Path

Disallow

yak

Rule

Path

Disallow

yandex

Rule

Path

Disallow

zyborg

Rule

Path

Disallow

*

Rule

Path

Disallow

/pj/7_another_27s/

Disallow

/*.asp

Disallow

*.asp

Disallow

.asp

Disallow

.asp?.*

Disallow

/anime/*.asp

Disallow

/anime/*.asp*

Disallow

/anime/.asp

Disallow

/anime/.asp?.*

Disallow

/anime/attr.asp

Disallow

/anime/attr.asp.*

Disallow

/anime/change_review.asp

Disallow

/anime/edit_not_like.asp

Disallow

/anime/edit_not_like.asp.*

Disallow

/anime/product.asp

Disallow

/anime/product.asp.*

Disallow

/anime/profile.asp?*&mode=get_pmail*

Disallow

/anime/tree/

Disallow

/anime/not_like.asp

Disallow

/*/related_*.html

Disallow

/*/titlerank.html

Disallow

/*/pricerank.html

Disallow

/*/-pricerank.html

Disallow

/*/-orig-rel-date.html

Disallow

/*/orig-rel-date.html

Disallow

/*/related_category.html

Disallow

/*/related_title.html

Disallow

/*/related_evaluation.html

Disallow

/*/related_deviation.html

Disallow

/*/related_review_num.html

Disallow

/*/related_point.html

Disallow

/tj/*/diary.html

Disallow

/janime/*/diary.html

Disallow

/jgame/*/diary.html

Disallow

/jdrama/*/diary.html

Disallow

/jmanga/*/diary.html

Disallow

/jbook/*/diary.html

Disallow

/jspecial/*/diary.html

Disallow

/jmovie/*/diary.html

Disallow

/jjpmovie/*/diary.html

Disallow

/anime/input_tag.asp

Disallow

/anime/input_tag.asp?*

Disallow

/anime/change_review.asp

Disallow

/anime/change_review.asp?*

Disallow

/anime/j_tb.html

Disallow

/anime/e_tb.html

Disallow

/anime/j_tb.html.*

Disallow

/anime/e_tb.html.*

Disallow

/anime/j_tb.html?*

Disallow

/anime/e_tb.html?*

Disallow

/anime/recommend_review.asp

Disallow

/anime/recommend_review.asp*

Disallow

/anime/redir*

Disallow

/anime/redir.*

Disallow

/anime/redirect_anime.asp

Disallow

/anime/redirect_anime.asp*

Disallow

/anime/redirect_anime.asp?*

Disallow

/anime/redir_j_am_idol.html

Disallow

/anime/redir_j_am_idol.html*

Disallow

/anime/redir_j_am_idol.html?*

Disallow

/anime/redir_j_al_search.html

Disallow

/anime/redir_j_al_search.html*

Disallow

/anime/redir_j_al_search.html.*

Disallow

/anime/redir_j_al_search.html?*

Disallow

/anime/redir_j_al_search.html?.*

Disallow

/anime/redir_j_al_ssearch.html

Disallow

/anime/redir_j_al_ssearch.html*

Disallow

/anime/redir_j_al_ssearch.html.*

Disallow

/anime/redir_j_al_ssearch.html?*

Disallow

/anime/redir_j_al_ssearch.html?.*

Disallow

/anime/redir_j_rn_search.html

Disallow

/anime/redir_j_rn_search.html*

Disallow

/anime/redir_j_rn_search.html.*

Disallow

/anime/redir_j_rn_search.html?*

Disallow

/anime/redir_j_rn_search.html?.*

Disallow

/anime/redir_j_rn_ssearch.html

Disallow

/anime/redir_j_rn_ssearch.html*

Disallow

/anime/redir_j_rn_ssearch.html.*

Disallow

/anime/redir_j_rn_ssearch.html?*

Disallow

/anime/redir_j_rn_ssearch.html?.*

Disallow

/anime/redir_j_ya_search.html

Disallow

/anime/redir_j_ya_search.html*

Disallow

/anime/redir_j_ya_search.html.*

Disallow

/anime/redir_j_ya_search.html?*

Disallow

/anime/redir_j_ya_search.html?.*

Disallow

/anime/redir_j_ya_ssearch.html

Disallow

/anime/redir_j_ya_ssearch.html*

Disallow

/anime/redir_j_ya_ssearch.html.*

Disallow

/anime/redir_j_ya_ssearch.html?*

Disallow

/anime/redir_j_ya_ssearch.html?.*

Disallow

/anime/redir_j_ys_search.html

Disallow

/anime/redir_j_ys_search.html*

Disallow

/anime/redir_j_ys_search.html.*

Disallow

/anime/redir_j_ys_search.html?*

Disallow

/anime/redir_j_ys_search.html?.*

Disallow

/anime/redir_j_ys_ssearch.html

Disallow

/anime/redir_j_ys_ssearch.html*

Disallow

/anime/redir_j_ys_ssearch.html.*

Disallow

/anime/redir_j_ys_ssearch.html?*

Disallow

/anime/redir_j_ys_ssearch.html?.*

Disallow

/anime/redir_j_am.html?.*

Disallow

/anime/redir_j_am.html?.*

Disallow

/anime/redir_j_am.html

Disallow

/anime/redir_e_am.html

Disallow

/anime/redir_j_am.html*

Disallow

/anime/redir_e_am.html*

Disallow

/anime/redir_j_am.html?*

Disallow

/anime/redir_e_am.html?*

Disallow

/anime/product.asp*sort%3D*

Disallow

/anime/redir_j_am.html*

Disallow

/anime/redir_e_am.html*

Disallow

/anime/product.asp?*sort=*

Disallow

/analyzed*

Disallow

.cgi

Disallow

*.cgi

Disallow

*.cgi?*

Disallow

*.cgi*

Disallow

/attrj/

Disallow

/attre/

Disallow

/attrj/*

Disallow

/attre/*

Disallow

/tmj/

Disallow

/tme/

Disallow

/anime/attr.cgi

Disallow

/anime/attr.cgi*

Disallow

/attrj/

Disallow

/mail/suggest_delete.cgi*

Disallow

/mail/suggest_delete.cgi?

Disallow

/archive/mailer/simple.cgi*

Disallow

/archive/mailer/simple.cgi?

Disallow

/anime/attr.cgi

Disallow

/anime/attr.cgi*

Disallow

/anime/attr.asp

Disallow

/anime/attr.asp*

Disallow

/anime/comment.cgi

Disallow

/anime/comment.cgi*

Disallow

/anime/comment.cgi?

Disallow

/anime/comment.asp?.*&user_name=*

Disallow

/anime/i_read.asp

Disallow

/anime/i_read.asp?

Disallow

/anime/i_read.asp?*

Disallow

/anime/delete_comment.cgi*

Disallow

/anime/delete_comment.cgi?

Disallow

/anime/edit_comment.asp

Disallow

/anime/edit_comment.asp*

Disallow

/anime/edit_comment.asp?

Disallow

/anime/edit_works_comment.asp

Disallow

/anime/edit_works_comment.asp*

Disallow

/anime/edit_works_comment.asp?

Disallow

/anime/profile.asp?name=%B6%E1%B1%D2%C4%BE%BC%F9&*

Disallow

/anime/sd.cgi*

Disallow

/*.gif$

Disallow

/*.jpg$

Disallow

/mail/M_R.cgi*

Disallow

/anime/profile.cgi*

Disallow

/teiban/top_cnt.cgi

Disallow

/teiban/top_cnt.cgi*

Disallow

/teiban/top_cnt.cgi?

Disallow

/teiban/best_cnt.cgi

Disallow

/teiban/best_cnt.cgi*

Disallow

/teiban/best_cnt.cgi?

Disallow

/anime/profile.asp?*&mode=freq&eval=*

bingbot

Rule

Path

Disallow

bingbot

Rule

Path

Disallow

msnbot

Rule

Path

Disallow

Other Records

Field

Value

sitemap

http://sakuhindb.com/j_sitemap.xml

Comments

below should be copied to robots_en.txt
Disallow: /anime/comment.asp
Disallow: /anime/comment.asp*
Disallow: /anime/comment.asp?
Disallow: /mail/list.cgi*

Warnings

6 invalid lines.

sakuhindb.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

accelatech rsscrawler

adsbot

adscanner

ahrefsbot

aihitbot

aipbot

anthropic-ai

applebot

backlinkcrawler

baiduimagespider

baidumobaider

baiduspider

baiduspider+

barkrowler

becomebot

blexbot

blogshot

bubing

buck

careerbot

ccbot

chatgpt-user

checkmarknetwork

cincraw

cliqzbot

cloudservermarketspider

coccoc

cohere-ai

crawler

crawler4j

dataforseobot

daumoa

df

df bot

domain re-animator bot

domaincrawler

domainstatsbot

dotbot

dotbot

download ninja

e-societyrobot

exabot

facebookbot

fr-crawler

garlikcrawler

google-extended

gosign-security-crawler

gptbot

grapeshot

haosouspider

hatena

hatena antenna

i-market-bot

iccrawler

implisensebot

indeedbot

inetdex-bot

irlbot

jobboersebot

jobs.de-robot

just-crawler

kraken

kyoto-crawler

linguee

linkstats

lipperhey-kaus-australis

ltx71

lwp

magpie-crawler

meanpathbot

megaindex.com

megaindex.ru

meta-externalagent

metajobbot

mindupbot

sakuhindb.com
robots.txt