datazoo.jp
robots.txt
Robots Exclusion Standard data for datazoo.jp
Resource Scan
Scan Details
Site Domain | datazoo.jp |
Base Domain | datazoo.jp |
Scan Status | Ok |
Last Scan | 2024-11-09T18:38:40+00:00 |
Next Scan | 2024-11-16T18:38:40+00:00 |
Last Scan
Scanned | 2024-11-09T18:38:40+00:00 |
URL | https://datazoo.jp/robots.txt |
Domain IPs | 54.64.180.63 |
Response IP | 54.64.180.63 |
Found | Yes |
Hash | 279c8d8e616de8be519a24f74ad235bb8aef7adb78a454600ede3a717870241f |
SimHash | c09cca04f7f9 |
Groups
linespider
linespider/1.1
femtosearchbot
femtosearchbot/1.0
ias_crawler
nutch crawler
paperlibot/2.1
paperlibot
mediatoolkitbot
trendictionbot
icc-crawler
netseer crawler/2.0
ccbot/2.0
andexbot/3.0
discordbot/2.0
clipper
garlikcrawler/1.2
blexbot
yeti
dotbot
dotbot
dotbot/1.1
netestate ne crawler
magaindex
megaindex.ru/2.0
mj12bot
proximic
bingbot
bingbot/2.0
buibui-bot
buibui-bot/1.0
ahrefsbot
msnbot
bingbot
slurp
yahoo! slurp
grapeshotcrawler
semrushbot
semrushbot-sa
cliqzbot
yandexbot/3.0
yandexmobilebot/3.0
mappy
linguee
obot
bdcbot
archive.org_bot
smtbot
special_archiver
Rule | Path |
---|---|
Disallow | / |