hinata.jp
robots.txt

Robots Exclusion Standard data for hinata.jp

Resource Scan

Scan Details

Site Domain hinata.jp
Base Domain hinata.jp
Scan Status Ok
Last Scan2024-10-23T06:52:01+00:00
Next Scan 2024-11-22T06:52:01+00:00

Last Scan

Scanned2024-10-23T06:52:01+00:00
URL https://hinata.jp/robots.txt
Redirect https://www.hinata.jp/robots.txt
Redirect Domain www.hinata.jp
Redirect Base hinata.jp
Domain IPs 163.44.185.225
Redirect IPs 163.44.185.225
Response IP 163.44.185.225
Found Yes
Hash a137089f915d707fe0d8399f1d343bdb802d364a04978d63f966be9f139eabe8
SimHash 10747172ca92

Groups

*

Rule Path
Disallow /non/author/tomo-dc2rveg

ia_archiver

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baiduimagespider+

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

yeti

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

noxtrumbot

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

becomejpbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Warnings

  • 2 invalid lines.