ml.naxos.jp
robots.txt

Robots Exclusion Standard data for ml.naxos.jp

Resource Scan

Scan Details

Site Domain ml.naxos.jp
Base Domain naxos.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-01T08:44:05+00:00
Next Scan 2025-11-08T08:44:05+00:00

Last Successful Scan

Scanned2025-09-29T15:05:09+00:00
URL https://ml.naxos.jp/robots.txt
Domain IPs 151.101.130.225, 151.101.194.225, 151.101.2.225, 151.101.66.225, 2a04:4e42:200::737, 2a04:4e42:400::737, 2a04:4e42:600::737, 2a04:4e42::737
Response IP 199.232.46.225
Found Yes
Hash ae612200ed51151f8cae9d664a41123448c73f925ec3844f414a956e043d879b
SimHash 511cd061a130

Groups

seekbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot
yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bubing

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

*

Rule Path
Disallow /*.html
Disallow /*.asp
Disallow /mypage/
Disallow /Resources/
Disallow /ontomo/
Disallow /TrialEnd.aspx
Disallow /?af=*
Disallow /*.pdf
Disallow /sharefiles
Disallow /blurb
Disallow /genre
Disallow /recommend
Disallow /label

Warnings

  • 2 invalid lines.