hateblo.jp
robots.txt

Robots Exclusion Standard data for hateblo.jp

Resource Scan

Scan Details

Site Domain hateblo.jp
Base Domain hateblo.jp
Scan Status Ok
Last Scan2024-10-20T08:33:10+00:00
Next Scan 2024-11-19T08:33:10+00:00

Last Scan

Scanned2024-10-20T08:33:10+00:00
URL https://hateblo.jp/robots.txt
Redirect https://hatena.blog/robots.txt
Redirect Domain hatena.blog
Redirect Base hatena.blog
Domain IPs 35.75.255.9, 54.199.90.60
Redirect IPs 13.35.210.20, 13.35.210.36, 13.35.210.88, 13.35.210.94
Response IP 13.35.210.36
Found Yes
Hash 973f5a479d092c6f5d498f74f815cfae0673337464361af86dc997b25d53695f
SimHash 4d00c156d597

Groups

*

Rule Path
Allow /*
Disallow /dev/api/internal/
Disallow /api/
Allow /api/diary_redirect