m.star.mt.co.kr
robots.txt

Robots Exclusion Standard data for m.star.mt.co.kr

Resource Scan

Scan Details

Site Domain m.star.mt.co.kr
Base Domain mt.co.kr
Scan Status Ok
Last Scan2024-09-07T09:57:43+00:00
Next Scan 2024-10-07T09:57:43+00:00

Last Scan

Scanned2024-09-07T09:57:43+00:00
URL https://m.star.mt.co.kr/robots.txt
Redirect https://m.starnewskorea.com/robots.txt
Redirect Domain m.starnewskorea.com
Redirect Base starnewskorea.com
Domain IPs 61.100.4.214
Redirect IPs 104.18.20.174, 104.18.21.174, 2606:4700::6812:14ae, 2606:4700::6812:15ae
Response IP 104.18.20.174
Found Yes
Hash 0bfcbc884e82f2bae97baba3240d2ed192a80f415e08688a80147560e3efa902
SimHash 6942772624f4

Groups

googlebot

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

googlebot-news

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

googlebot-image

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

googlebot-video

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

mediapartners-google

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

google search console

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

googlebot/2.1

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

googlebot-smartphone

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

bingbot

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

bingpreview

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

msnbot

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

msnbot-media

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

facebot

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

facebookexternalhit/1.1

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

facebookcatalog/1.0

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

yeti

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

daumoa

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

twitterbot

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

grapeshot

Rule Path
Allow /

*

Rule Path
Allow /
Allow /view.html
Allow /article.html
Allow /starranking.html
Allow /ads.txt
Disallow /starrankingLogin.html
Disallow /starrankingVote.php
Disallow /api/

Other Records

Field Value
sitemap https://m.starnewskorea.com/sitemap.xml
sitemap https://m.starnewskorea.com/sitemap/news/daily.xml
sitemap https://m.starnewskorea.com/sitemap/article/daily.xml
sitemap https://m.starnewskorea.com/sitemap/image/daily.xml
sitemap https://m.starnewskorea.com/sitemap/video/daily.xml

Comments

  • Robots for m.starnewskorea.com
  • Google
  • Bing
  • MSN
  • Facebook
  • Naver
  • Daum
  • Twitter
  • Oracle
  • ETC
  • SiteMap
  • DaumWebMasterTool:a62eaf4f0b19782a8236dbe1f8562df81ebbd8bf2e762a49294c116efdc77666:Q4NPkvO1hYLac9d2XA+e1w==