ndlsearch.ndl.go.jp
robots.txt
Robots Exclusion Standard data for ndlsearch.ndl.go.jp
Resource Scan
Scan Details
| Site Domain | ndlsearch.ndl.go.jp |
| Base Domain | ndl.go.jp |
| Scan Status | Ok |
| Last Scan | 2024-11-03T07:23:30+00:00 |
| Next Scan | 2024-12-03T07:23:30+00:00 |
Last Scan
| Scanned | 2024-11-03T07:23:30+00:00 |
| URL | https://ndlsearch.ndl.go.jp/robots.txt |
| Domain IPs | 108.156.133.31, 108.156.133.33, 108.156.133.71, 108.156.133.97 |
| Response IP | 108.156.133.71 |
| Found | Yes |
| Hash | 02cc67318f936a34778ebaeb11d6d3776b9aa64a5d53fdbe3e72a4dd6f49b6e7 |
| SimHash | e149f84c89c9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account |
| Disallow | /emailchg |
| Disallow | /ksp |
| Disallow | /error |
| Disallow | /favorite |
| Disallow | /ill_request/ |
| Disallow | /inputpassword |
| Disallow | /openurl |
| Disallow | /register/ |
| Disallow | /request |
| Disallow | /resetpassword/complete |
| Disallow | /settings/library |
| Disallow | /user |
| Disallow | /search/history |
| Disallow | /en/account |
| Disallow | /en/emailchg |
| Disallow | /en/ksp |
| Disallow | /en/error |
| Disallow | /en/favorite |
| Disallow | /en/ill_request/ |
| Disallow | /en/inputpassword |
| Disallow | /en/openurl |
| Disallow | /en/register/ |
| Disallow | /en/request |
| Disallow | /en/resetpassword/complete |
| Disallow | /en/settings/library |
| Disallow | /en/user |
| Disallow | /en/search/history |
| Disallow | /api |
| Disallow | /statistics |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ndlsearch.ndl.go.jp/sitemap.xml |