news.khan.co.kr
robots.txt

Robots Exclusion Standard data for news.khan.co.kr

Resource Scan

Scan Details

Site Domain news.khan.co.kr
Base Domain khan.co.kr
Scan Status Ok
Last Scan2024-05-22T07:53:28+00:00
Next Scan 2024-06-21T07:53:28+00:00

Last Scan

Scanned2024-05-22T07:53:28+00:00
URL https://news.khan.co.kr/robots.txt
Domain IPs 23.45.176.173, 23.45.176.174
Response IP 104.91.69.115
Found Yes
Hash b034d8399dbbd72d2f8253da384c319d6006df61cb1293ab82155f5d567af916
SimHash c816420472f1

Groups

*

Rule Path
Disallow /

yeti

Rule Path
Disallow /kh_news/khan_art_view.html?artid=201609241422011&code=940100

daumoa

Rule Path
Disallow /kh_news/khan_art_view.html?artid=201609241422011&code=940100

daumwebmastertool

Rule Path
Disallow

twitterbot

Rule Path
Disallow

googlebot

Rule Path
Disallow /kh_news/khan_art_view.html?artid=201609241422011&code=940100

googlebot-news

Rule Path
Disallow /kh_news/khan_art_view.html?artid=201609241422011&code=940100

googlebot-image

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

popin_agent

Rule Path
Disallow

grapeshot

Rule Path
Disallow

bingbot

Rule Path
Disallow