the-miyanichi.co.jp
robots.txt
Robots Exclusion Standard data for the-miyanichi.co.jp
Resource Scan
Scan Details
| Site Domain | the-miyanichi.co.jp |
| Base Domain | the-miyanichi.co.jp |
| Scan Status | Ok |
| Last Scan | 2024-09-14T14:45:53+00:00 |
| Next Scan | 2024-09-21T14:45:53+00:00 |
Last Scan
| Scanned | 2024-09-14T14:45:53+00:00 |
| URL | https://the-miyanichi.co.jp/robots.txt |
| Redirect | https://www.the-miyanichi.co.jp/robots.txt |
| Redirect Domain | www.the-miyanichi.co.jp |
| Redirect Base | the-miyanichi.co.jp |
| Domain IPs | 42.127.242.5 |
| Redirect IPs | 42.127.242.5 |
| Response IP | 42.127.242.5 |
| Found | Yes |
| Hash | 60baf001adadc7a64f2a39cc1feba8fd93022bf2ea0631f084d4b3adbe0dec69 |
| SimHash | 6844d050539e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /contents/media/6/*.jpg |
| Disallow | /preview/ |
| Disallow | /include2/ |
| Disallow | /shinmoe/ |
| Disallow | /e-life/ |
| Disallow | /shimbun/ |
| Disallow | /domestic/ |
| Disallow | /feature/ |
| Disallow | /column/ |
| Disallow | /newspack/ |
| Disallow | /mphoto/ |
| Disallow | /books/ |
| Disallow | /jigyo_koen/ |
| Disallow | /mannai/ |
| Disallow | /grace_html/ |
| Disallow | /grace/ |
| Disallow | /boshi/ |
| Disallow | /movie/ |
| Disallow | /fp/ |
| Disallow | /link/ |
| Disallow | /mobile/ |
| Disallow | /jigyou/ |
| Disallow | /img/ |
| Disallow | /pdf/ |
| Disallow | /koyomi/ |
| Disallow | /prwire/ |
| Disallow | /include/ |
| Disallow | /young/ |
| Disallow | /election/ |
| Disallow | /toko_int/ |
| Disallow | /dokusho_con/ |
| Disallow | /mnie/ |
| Disallow | /930tv/ |
| Disallow | /toko/ |
| Disallow | /kensyou/ |
| Disallow | /miyanichi-kaikan/ |
| Disallow | /p-shop/ |
| Disallow | /news/index.php3?PT=1 |
| Disallow | /index.php3 |
| Disallow | /contact/ContactFN.php |
| Disallow | /news/index.php3 |
| Disallow | /moyousi/ |
| Disallow | /entame/ |
| Disallow | /news/Entertainment_Trends/ |
| Disallow | /news/olddataChk.php3?PT=1 |
| Disallow | /news/olddataChk.php3?PT=4 |
| Disallow | /news/olddataChk.php3?PT=2 |
| Disallow | /news/index.php3?PT=1&DT=20051112 |
| Disallow | /news/index.php3?PT=1&DT=20060701 |
| Disallow | /news/index.php3?PT=1&DT=20030326 |
| Disallow | /news/index.php3?PT=1&DT=20030316 |
| Disallow | /news/index.php3?PT=2&DT=20050219 |
| Disallow | /news/index.php3?PT=1&DT=20050724 |
| Disallow | /news/index.php3?PT=6 |
| Disallow | /news/news/index.php3?PT=19 |
| Disallow | /news/index.php3?PT=16 |
| Disallow | /news/index.php3?PT=1&DT=20040804 |
| Disallow | /news/index.php3?PT=3&DT=20020411 |
| Disallow | /news/index.php3?PT=4&DT=20041026 |
| Disallow | /news/index.php3?PT=7&DT=20051222 |
| Disallow | /news/index.php3?PT=5 |
| Disallow | /footer/ |
| Disallow | /sp/ |
| Disallow | /db/ |
| Disallow | /sports/ekiden/southkyusyu/60.html |
| Disallow | /koudoku/ |
| Disallow | /enquete/enq.cgi |
| Disallow | /mediadata/ |
| Disallow | /special/grace/2017/write.php |
| Disallow | /special/nordot/ |
| Disallow | /special/webcp/2016/send.php |
| Disallow | /special/thanks/2018/send.php |
| Disallow | /special/kidssoccer/2019/entry_web.php |
| Disallow | /special/kidssoccer/2019/entry_confirm.php |
| Disallow | /special/kidssoccer/2019/write.php |
| Disallow | /special/campinfo/2021/write.php |
| Disallow | /special/campinfo/2021/complete.php |
| Disallow | /special/onkon/onkon_21/form/basic_write.php |
| Disallow | /special/sdgs/index.php/news.php |
| Disallow | /special/kidssoccer/2023/write.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |