b.st-hatena.com
robots.txt

Robots Exclusion Standard data for b.st-hatena.com

Resource Scan

Scan Details

Site Domain b.st-hatena.com
Base Domain st-hatena.com
Scan Status Ok
Last Scan2025-10-08T06:04:39+00:00
Next Scan 2025-10-22T06:04:39+00:00

Last Scan

Scanned2025-10-08T06:04:39+00:00
URL https://b.st-hatena.com/robots.txt
Domain IPs 13.35.202.128, 13.35.202.19, 13.35.202.42, 13.35.202.68
Response IP 13.35.202.42
Found Yes
Hash 91bf2986505268eb6fd155aca345e0d2029ace8e1e3cd50980c810db6eafb921
SimHash e844c9f44552

Groups

*

Rule Path
Disallow /api/entry/http
Disallow /api/entry/info
Disallow /api/internal/bookmarks/shares_and_clicks
Disallow /api/internal/cambridge/user
Disallow /api/related_entries/
Disallow /api/users/*/bookmarks
Disallow /entry/button/
Disallow /entry.count
Disallow /entry/image/
Disallow /entry/jsonlite
Disallow /guide/bbutton?url=*
Disallow /-/webextension/*

slurp

Rule Path
Disallow /

googlebot
mediapartners-google

Rule Path
Disallow /api/entry/http
Disallow /api/entry/info
Disallow /api/internal/bookmarks/shares_and_clicks
Disallow /api/internal/cambridge/user
Disallow /api/related_entries/
Disallow /api/users/*/bookmarks
Disallow /entry/button/
Disallow /entry.count
Disallow /entry/*/comment/*
Disallow /entry/image/
Disallow /entry/jsonlite
Disallow /guide/bbutton?url=*
Disallow /-/webextension/*