kuku.co.jp
robots.txt

Robots Exclusion Standard data for kuku.co.jp

Resource Scan

Scan Details

Site Domain kuku.co.jp
Base Domain kuku.co.jp
Scan Status Ok
Last Scan2024-10-29T03:56:40+00:00
Next Scan 2024-11-28T03:56:40+00:00

Last Scan

Scanned2024-10-29T03:56:40+00:00
URL http://kuku.co.jp/robots.txt
Domain IPs 15.168.3.31
Response IP 15.168.3.31
Found Yes
Hash 2e4dea274c751fb80a494f56176dd740c25d2489e66bb1171d363775340d5018
SimHash 5b35d2eac693

Groups

yandex
wotbox
http://www.wotbox.com/bot/
wotbox/2.01
trendictionbot
blexbot
blexbot/1.0
exabot
exabot/3.0
http://www.exabot.com/go/robot
steeler
dotbot
http://www.linkpad.ru
mj12bot
mj12bot/v1.4.0
http://www.majestic12.co.uk/bot.php?+
linkpadbot/1.06
archive.org_bot
http://www.archive.org/details/archive.org_bot
baiduspider
baiduspider/2.0
http://www.baidu.com/search/spider.html
ahrefsbot/2.0
ahrefs
http://ahrefs.com/robot/
http://www.sogou.com/docs/help/webmasters.htm
sogou
sogou web spider/4.0
http://www.sogou.com/docs/help/webmasters.htm
sogou spider
proximic
http://www.proximic.com/info/spider.php
bingbot
slurp
ahrefs
http://ahrefs.com/robot/
ahrefsbot/4.0
ahrefsbot
ahrefs.com

Product Comment
http://www.sogou.com/docs/help/webmasters.htm 07
Rule Path
Disallow /

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

Warnings

  • 1 invalid line.