baito.mynavi.jp
robots.txt
Robots Exclusion Standard data for baito.mynavi.jp
Resource Scan
Scan Details
| Site Domain | baito.mynavi.jp |
| Base Domain | mynavi.jp |
| Scan Status | Ok |
| Last Scan | 2024-05-17T06:46:28+00:00 |
| Next Scan | 2024-05-24T06:46:28+00:00 |
Last Scan
| Scanned | 2024-05-17T06:46:28+00:00 |
| URL | https://baito.mynavi.jp/robots.txt |
| Domain IPs | 13.33.88.114, 13.33.88.35, 13.33.88.55, 13.33.88.74, 2600:9000:223b:1800:19:a438:c280:93a1, 2600:9000:223b:200:19:a438:c280:93a1, 2600:9000:223b:6400:19:a438:c280:93a1, 2600:9000:223b:8000:19:a438:c280:93a1, 2600:9000:223b:800:19:a438:c280:93a1, 2600:9000:223b:9a00:19:a438:c280:93a1, 2600:9000:223b:aa00:19:a438:c280:93a1, 2600:9000:223b:be00:19:a438:c280:93a1 |
| Response IP | 13.33.88.74 |
| Found | Yes |
| Hash | fc96fdf9454a15e0f733fc143a69c72e86c15ee0ac5af42da8ca14add6f0c17c |
| SimHash | aa1c10004f10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /mc/ |
| Disallow | /client/ |
| Disallow | /sp/common/ |
| Disallow | /*select%3D* |
| Disallow | /*/feature/ |
| Disallow | /cl/ |
| Disallow | /?pageNo= |
| Disallow | /?sortType= |
| Disallow | /entry/EntryInput.do?jobStockCd= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://baito.mynavi.jp/sitemap_index.xml |
| sitemap | https://baito.mynavi.jp/kw/keyword-sitemap-index.xml |
Warnings
- 3 invalid lines.