news.kbs.co.kr
robots.txt
Robots Exclusion Standard data for news.kbs.co.kr
Resource Scan
Scan Details
Site Domain | news.kbs.co.kr |
Base Domain | kbs.co.kr |
Scan Status | Ok |
Last Scan | 2024-06-21T21:15:19+00:00 |
Next Scan | 2024-07-21T21:15:19+00:00 |
Last Scan
Scanned | 2024-06-21T21:15:19+00:00 |
URL | https://news.kbs.co.kr/robots.txt |
Domain IPs | 13.33.30.14, 13.33.30.25, 13.33.30.41, 13.33.30.94 |
Response IP | 13.33.30.94 |
Found | Yes |
Hash | d80c61eba7cfa0d181f919606693097bfecc7e95b5851cba45f8c315b08b0407 |
SimHash | 011458404053 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /resources |
Disallow | /api |
Disallow | /sokbo |
Disallow | /external |
Disallow | /preview |
Other Records
Field | Value |
---|---|
sitemap | https://news.kbs.co.kr/sitemap/recentNewsList.xml |
sitemap | https://news.kbs.co.kr/sitemap/dailyNewsList.xml |
sitemap | https://news.kbs.co.kr/sitemap/danuri.xml |
sitemap | https://news.kbs.co.kr/sitemap/election2024.xml |