b.hatena.ne.jp
robots.txt

Robots Exclusion Standard data for b.hatena.ne.jp

Resource Scan

Scan Details

Site Domain b.hatena.ne.jp
Base Domain hatena.ne.jp
Scan Status Ok
Last Scan2024-06-02T16:21:12+00:00
Next Scan 2024-06-16T16:21:12+00:00

Last Scan

Scanned2024-06-02T16:21:12+00:00
URL https://b.hatena.ne.jp/robots.txt
Domain IPs 54.192.18.110, 54.192.18.54, 54.192.18.62, 54.192.18.77
Response IP 108.156.133.16
Found Yes
Hash 91bf2986505268eb6fd155aca345e0d2029ace8e1e3cd50980c810db6eafb921
SimHash e844c9f44552

Groups

*

Rule Path
Disallow /api/entry/http
Disallow /api/entry/info
Disallow /api/internal/bookmarks/shares_and_clicks
Disallow /api/internal/cambridge/user
Disallow /api/related_entries/
Disallow /api/users/*/bookmarks
Disallow /entry/button/
Disallow /entry.count
Disallow /entry/image/
Disallow /entry/jsonlite
Disallow /guide/bbutton?url=*
Disallow /-/webextension/*

slurp

Rule Path
Disallow /

googlebot
mediapartners-google

Rule Path
Disallow /api/entry/http
Disallow /api/entry/info
Disallow /api/internal/bookmarks/shares_and_clicks
Disallow /api/internal/cambridge/user
Disallow /api/related_entries/
Disallow /api/users/*/bookmarks
Disallow /entry/button/
Disallow /entry.count
Disallow /entry/*/comment/*
Disallow /entry/image/
Disallow /entry/jsonlite
Disallow /guide/bbutton?url=*
Disallow /-/webextension/*