regimag.jp
robots.txt
Robots Exclusion Standard data for regimag.jp
Resource Scan
Scan Details
Site Domain | regimag.jp |
Base Domain | regimag.jp |
Scan Status | Ok |
Last Scan | 2024-08-30T00:25:54+00:00 |
Next Scan | 2024-09-29T00:25:54+00:00 |
Last Scan
Scanned | 2024-08-30T00:25:54+00:00 |
URL | https://regimag.jp/robots.txt |
Domain IPs | 13.225.4.104, 13.225.4.129, 13.225.4.32, 13.225.4.97 |
Response IP | 13.225.4.104 |
Found | Yes |
Hash | 32062984091f5f85751ffb762864f753c13debfe58395a1b80b417bc79cc25c3 |
SimHash | d90c6c026d93 |
Groups
*
Rule | Path |
---|---|
Disallow | /bo/rss/index |
Disallow | /horse_racing/follow |
Disallow | /horse_racing/article_list_pager |
Disallow | /jra_ipat/ |
Disallow | /tunnel.html |
Disallow | /horse_racing/content_hit_follow |
Other Records
Field | Value |
---|---|
sitemap | https://regimag.jp/sitemap.xml |