pub.chosun.com
robots.txt
Robots Exclusion Standard data for pub.chosun.com
Resource Scan
Scan Details
| Site Domain | pub.chosun.com |
| Base Domain | chosun.com |
| Scan Status | Ok |
| Last Scan | 2024-05-25T13:40:59+00:00 |
| Next Scan | 2024-06-24T13:40:59+00:00 |
Last Scan
| Scanned | 2024-05-25T13:40:59+00:00 |
| URL | https://pub.chosun.com/robots.txt |
| Domain IPs | 13.209.227.83 |
| Response IP | 13.209.227.83 |
| Found | Yes |
| Hash | cd7f9fde74999215bd43c64000682e22a430808d7b1c4b01995dda4345181342 |
| SimHash | 0740180645d4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /spn/site/* |
| Disallow | /pri* |
| Disallow | /sv* |
| Disallow | /biz* |
| Disallow | /spn/sv* |
| Disallow | /mchosun* |
| Disallow | /smart* |
| Disallow | /premium* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://news.chosun.com/sitemap/index.xml |
| sitemap | https://news.chosun.com/google/rss.html |
| sitemap | https://news.chosun.com/site/data/rss/rss.xml |