m.mt.co.kr
robots.txt
Robots Exclusion Standard data for m.mt.co.kr
Resource Scan
Scan Details
Site Domain | m.mt.co.kr |
Base Domain | mt.co.kr |
Scan Status | Ok |
Last Scan | 2024-10-23T02:02:30+00:00 |
Next Scan | 2024-11-22T02:02:30+00:00 |
Last Scan
Scanned | 2024-10-23T02:02:30+00:00 |
URL | https://m.mt.co.kr/robots.txt |
Domain IPs | 104.18.30.220, 104.18.31.220 |
Response IP | 104.18.30.220 |
Found | Yes |
Hash | 8f0b006884793d5f9be5da564522fbf21f3ee019930cedbbba02a44e4478f9a7 |
SimHash | 41d04a141df5 |
Groups
*
googlebot
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
popin_agent
bingbot
msnbot
msnbot-media
bingpreview
facebot
yeti
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
twitterbot
google search console
googlebot/2.1
googlebot-smartphone
grapeshot
Rule | Path |
---|---|
Allow | /renew/view.html |
Allow | /renew/view_amp.html |
Allow | /renew/news.html |
Allow | /renew/flashnews.html |
Allow | /renew/ |
Allow | /renew/?index=0 |
Allow | /renew/?index=1 |
Allow | /renew/?index=2 |
Allow | /renew/?index=3 |
Allow | /renew/?index=4 |
Allow | /renew/?index=5 |
Allow | /renew/?index=6 |
Allow | /renew/?index=7 |
Allow | /ads.txt |
Disallow | /newapp |
Disallow | /mtapp |
Disallow | /renew/gate |
Other Records
Field | Value |
---|---|
sitemap | https://m.mt.co.kr/sitemap.xml |
sitemap | https://m.mt.co.kr/mt_news.xml |
sitemap | https://m.mt.co.kr/sitemap/news/daily.xml |
sitemap | https://m.mt.co.kr/sitemap/article/daily.xml |
sitemap | https://m.mt.co.kr/sitemap/image/daily.xml |
sitemap | https://m.mt.co.kr/sitemap/video/daily.xml |
Comments