m.starnewskorea.com
robots.txt
Robots Exclusion Standard data for m.starnewskorea.com
Resource Scan
Scan Details
| Site Domain | m.starnewskorea.com |
| Base Domain | starnewskorea.com |
| Scan Status | Ok |
| Last Scan | 2024-10-22T01:40:16+00:00 |
| Next Scan | 2024-11-21T01:40:16+00:00 |
Last Scan
| Scanned | 2024-10-22T01:40:16+00:00 |
| URL | https://m.starnewskorea.com/robots.txt |
| Domain IPs | 104.18.20.174, 104.18.21.174, 2606:4700::6812:14ae, 2606:4700::6812:15ae |
| Response IP | 104.18.20.174 |
| Found | Yes |
| Hash | 0bfcbc884e82f2bae97baba3240d2ed192a80f415e08688a80147560e3efa902 |
| SimHash | 6942772624f4 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
googlebot-news
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
googlebot-image
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
googlebot-video
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
mediapartners-google
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
google search console
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
googlebot/2.1
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
googlebot-smartphone
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
bingpreview
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
msnbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
msnbot-media
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
facebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
facebookexternalhit/1.1
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
facebookcatalog/1.0
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
yeti
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
daumoa
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
twitterbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /view.html |
| Allow | /article.html |
| Allow | /starranking.html |
| Allow | /ads.txt |
| Disallow | /starrankingLogin.html |
| Disallow | /starrankingVote.php |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://m.starnewskorea.com/sitemap.xml |
| sitemap | https://m.starnewskorea.com/sitemap/news/daily.xml |
| sitemap | https://m.starnewskorea.com/sitemap/article/daily.xml |
| sitemap | https://m.starnewskorea.com/sitemap/image/daily.xml |
| sitemap | https://m.starnewskorea.com/sitemap/video/daily.xml |
Comments