news1.kr
robots.txt
Robots Exclusion Standard data for news1.kr
Resource Scan
Scan Details
Site Domain | news1.kr |
Base Domain | news1.kr |
Scan Status | Ok |
Last Scan | 2024-05-12T05:00:11+00:00 |
Next Scan | 2024-05-19T05:00:11+00:00 |
Last Scan
Scanned | 2024-05-12T05:00:11+00:00 |
URL | https://news1.kr/robots.txt |
Redirect | https://www.news1.kr/robots.txt |
Redirect Domain | www.news1.kr |
Redirect Base | news1.kr |
Redirect IPs | 125.56.219.25, 96.17.72.73 |
Response IP | 184.27.123.112 |
Found | Yes |
Hash | 62efb5ee0fd107c355152899ad2f7551f7b78561226dd06cdc301d8edf60f8b3 |
SimHash | fc2d4154ddb3 |
Groups
*
Rule | Path |
---|---|
Disallow | /ad_articles/ |
Disallow | /Classes/ |
Disallow | /Config/ |
Disallow | /election/ |
Disallow | /ads/ |
Disallow | /articles/article_print.php |
Disallow | /photos/details/article_print.php |
Disallow | /event/ |
Disallow | /execption/ |
Disallow | /ext/ |
Disallow | /external_service/ |
Disallow | /go-pyeongchang/ |
Disallow | /iframe/ |
Disallow | /inc/ |
Disallow | /include/ |
Disallow | /lib/ |
Disallow | /news1_www/ |
Disallow | /oauth/ |
Disallow | /popups/ |
Disallow | /pront_include/ |
Disallow | /search_front/ |
Disallow | /sports/ |
Disallow | /views/ |
Disallow | /categories/plan/ |
Disallow | /column/ |
Allow | /ads.txt |
Other Records
Field | Value |
---|---|
sitemap | https://www.news1.kr/feeds/news-sitemap/ |
sitemap | https://www.news1.kr/feeds/news-sitemap/photo/ |
sitemap | https://www.news1.kr/sitemap/sections/ |
sitemap | https://www.news1.kr/feeds/sitemap-index/ |
sitemap | https://www.news1.kr/feeds/news-sitemap/videos/ |
sitemap | https://www.news1.kr/feeds/google-news/ |
Comments