news.mt.co.kr
robots.txt

Robots Exclusion Standard data for news.mt.co.kr

Resource Scan

Scan Details

Site Domain news.mt.co.kr
Base Domain mt.co.kr
Scan Status Ok
Last Scan2024-11-14T02:51:33+00:00
Next Scan 2024-12-14T02:51:33+00:00

Last Scan

Scanned2024-11-14T02:51:33+00:00
URL https://news.mt.co.kr/robots.txt
Domain IPs 104.18.30.220, 104.18.31.220
Response IP 104.18.30.220
Found Yes
Hash 9f9074696adea733b37affc3345d19cc45995365940bacf77158a94bda4dfdc0
SimHash 2283cb070cf5

Groups

googlebot

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

googlebot-news

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

googlebot-image

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

googlebot-video

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

mediapartners-google

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

popin_agent

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

bingbot

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

msnbot

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

msnbot-media

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

bingpreview

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

facebot

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

yeti

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

facebookexternalhit/1.1

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

twitterbot

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

google search console

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

googlebot/2.1

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

googlebot-smartphone

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

grapeshot

Rule Path
Allow /
Allow /mtview.php
Allow /hotview.php
Allow /newsList.html
Disallow /newsPrint
Disallow /newsEmail

*

Rule Path
Allow /ads.txt
Disallow /newsPrint
Disallow /newsEmail

Other Records

Field Value
sitemap https://news.mt.co.kr/sitemap.xml
sitemap https://news.mt.co.kr/mt_news_google.xml
sitemap https://news.mt.co.kr/sitemap/news/daily.xml
sitemap https://news.mt.co.kr/sitemap/article/daily.xml
sitemap https://news.mt.co.kr/sitemap/image/daily.xml
sitemap https://news.mt.co.kr/sitemap/video/daily.xml

Comments

  • Robots for news.mt.co.kr
  • ETC
  • SiteMap