dic.nicovideo.jp
robots.txt
Robots Exclusion Standard data for dic.nicovideo.jp
Resource Scan
Scan Details
| Site Domain | dic.nicovideo.jp |
| Base Domain | nicovideo.jp |
| Scan Status | Ok |
| Last Scan | 2024-04-27T15:57:09+00:00 |
| Next Scan | 2024-05-27T15:57:09+00:00 |
Last Scan
| Scanned | 2024-04-27T15:57:09+00:00 |
| URL | https://dic.nicovideo.jp/robots.txt |
| Domain IPs | 133.152.40.115 |
| Response IP | 133.152.40.115 |
| Found | Yes |
| Hash | 9ab609869b7e7a49171389c2d485e4a4fba2d5a6ef523415ed6f9f0ade239d07 |
| SimHash | 6239f7775777 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /p/ |
| Disallow | /d/ |
| Disallow | /s/ |
| Disallow | /fla/ |
| Disallow | /mml/ |
| Disallow | /oelog/ |
| Disallow | /random |
| Disallow | /random/ |
| Disallow | /r/ |
| Disallow | /rd/ |
| Disallow | /revs/ |
| Disallow | /wp/ |
| Disallow | /api/ |
| Disallow | /wait/ |
| Disallow | /b/c/ |
| Disallow | /id/ |
| Disallow | /oekaki_id/ |
| Disallow | /mml_id/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |