news.mk.co.kr
robots.txt

Robots Exclusion Standard data for news.mk.co.kr

Resource Scan

Scan Details

Site Domain news.mk.co.kr
Base Domain mk.co.kr
Scan Status Ok
Last Scan2024-09-30T08:29:08+00:00
Next Scan 2024-10-30T08:29:08+00:00

Last Scan

Scanned2024-09-30T08:29:08+00:00
URL https://news.mk.co.kr/robots.txt
Domain IPs 220.73.139.224
Response IP 220.73.139.224
Found Yes
Hash b9e9db234797d4f27c2d6e1c1986fcf14ab748193d2488b62c4cc67233bd2a04
SimHash c905181447f5

Groups

googlebot

Rule Path
Allow /
Disallow /include/

googlebot-news

Rule Path
Allow /
Disallow /include/

googlebot-image

Rule Path
Allow /
Disallow /include/

mediapartners-google

Rule Path
Allow /
Disallow /include/

popin_agent

Rule Path
Allow /
Disallow /include/

bingbot

Rule Path
Allow /
Disallow /include/

facebot

Rule Path
Allow /
Disallow /include/

yeti

Rule Path
Allow /
Disallow /include/

facebookexternalhit/1.1

Rule Path
Allow /
Disallow /include/

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /
Disallow /include/

twitterbot

Rule Path
Allow /
Disallow /include/

*

Rule Path
Disallow /

Other Records

Field Value
sitemap http://news.mk.co.kr/v4/sitemap_google/sitemap_index.xml

Comments

  • robots.txt generated at http://www.mcanerin.com