kango.mynavi.jp
robots.txt
Robots Exclusion Standard data for kango.mynavi.jp
Resource Scan
Scan Details
| Site Domain | kango.mynavi.jp |
| Base Domain | mynavi.jp |
| Scan Status | Ok |
| Last Scan | 2024-05-16T15:30:06+00:00 |
| Next Scan | 2024-05-23T15:30:06+00:00 |
Last Scan
| Scanned | 2024-05-16T15:30:06+00:00 |
| URL | https://kango.mynavi.jp/robots.txt |
| Domain IPs | 52.199.56.9, 54.199.72.188 |
| Response IP | 54.199.72.188 |
| Found | Yes |
| Hash | 9b742b5c1fdec8955449c99fb5f4d9c3450058a54efc9611ddc9a029a093941f |
| SimHash | 471555798797 |
Groups
*
mozilla/5.0 (compatible; sbi navi-crawler)
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /search/searchAjax.php/ |
| Disallow | /medical_result/kensaku/work.php/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://kango.mynavi.jp/sitemap-index.xml |
| sitemap | https://kango.mynavi.jp/sitemap-detail_01.xml |
| sitemap | https://kango.mynavi.jp/sitemap-detail_02.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-area.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-cross-cat.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-line.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-other.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-pref-cross-cat_01.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-city-cross-cat_01.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-prefectures.xml |
| sitemap | https://kango.mynavi.jp/sitemap-list-st.xml |
| sitemap | https://kango.mynavi.jp/contents/nurseplus/sitemap.xml |
| sitemap | https://kango.mynavi.jp/sitemap-detail_01.xml |
Comments