m.mt.co.kr
robots.txt

Robots Exclusion Standard data for m.mt.co.kr

Resource Scan

Scan Details

Site Domain m.mt.co.kr
Base Domain mt.co.kr
Scan Status Ok
Last Scan2024-10-23T02:02:30+00:00
Next Scan 2024-11-22T02:02:30+00:00

Last Scan

Scanned2024-10-23T02:02:30+00:00
URL https://m.mt.co.kr/robots.txt
Domain IPs 104.18.30.220, 104.18.31.220
Response IP 104.18.30.220
Found Yes
Hash 8f0b006884793d5f9be5da564522fbf21f3ee019930cedbbba02a44e4478f9a7
SimHash 41d04a141df5

Groups

*
googlebot
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
popin_agent
bingbot
msnbot
msnbot-media
bingpreview
facebot
yeti
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
twitterbot
google search console
googlebot/2.1
googlebot-smartphone
grapeshot

Rule Path
Allow /renew/view.html
Allow /renew/view_amp.html
Allow /renew/news.html
Allow /renew/flashnews.html
Allow /renew/
Allow /renew/?index=0
Allow /renew/?index=1
Allow /renew/?index=2
Allow /renew/?index=3
Allow /renew/?index=4
Allow /renew/?index=5
Allow /renew/?index=6
Allow /renew/?index=7
Allow /ads.txt
Disallow /newapp
Disallow /mtapp
Disallow /renew/gate

Other Records

Field Value
sitemap https://m.mt.co.kr/sitemap.xml
sitemap https://m.mt.co.kr/mt_news.xml
sitemap https://m.mt.co.kr/sitemap/news/daily.xml
sitemap https://m.mt.co.kr/sitemap/article/daily.xml
sitemap https://m.mt.co.kr/sitemap/image/daily.xml
sitemap https://m.mt.co.kr/sitemap/video/daily.xml

Comments

  • Robots for m.mt.co.kr
  • Sitemap