hatena.ne.jp
robots.txt
Robots Exclusion Standard data for hatena.ne.jp
Resource Scan
Scan Details
Site Domain | hatena.ne.jp |
Base Domain | hatena.ne.jp |
Scan Status | Ok |
Last Scan | 2024-06-06T20:18:55+00:00 |
Next Scan | 2024-06-13T20:18:55+00:00 |
Last Scan
Scanned | 2024-06-06T20:18:55+00:00 |
URL | https://www.hatena.ne.jp/robots.txt |
Domain IPs | 3.112.179.3, 52.196.95.34 |
Response IP | 52.196.95.34 |
Found | Yes |
Hash | 95003915fb5c8d07f771442dc2a861614441c3bbd9c0593be004e2908e4b8ae3 |
SimHash | bced0436efda |
Groups
*
Rule | Path |
---|---|
Disallow | /prof/search |
Disallow | /mobile/prof/search |
Disallow | /faq/report/ |
Disallow | /api/ |
Disallow | /mobile/easylogin |
Disallow | /hatenatypered |
Other Records
Field | Value |
---|---|
sitemap | https://www.hatena.ne.jp/solution/blog/corporation/sitemap_index.xml |