topsinger.topstarnews.net
robots.txt

Robots Exclusion Standard data for topsinger.topstarnews.net

Resource Scan

Scan Details

Site Domain topsinger.topstarnews.net
Base Domain topstarnews.net
Scan Status Ok
Last Scan2024-06-04T15:44:53+00:00
Next Scan 2024-07-04T15:44:53+00:00

Last Scan

Scanned2024-06-04T15:44:53+00:00
URL https://topsinger.topstarnews.net/robots.txt
Domain IPs 114.200.196.82
Response IP 114.200.196.82
Found Yes
Hash 437e1c179fa6d9d44c613cc941108d84f026f673ede7c8f9b9b5262eea5d8fe1
SimHash 7054061160f7

Groups

*

Rule Path
Allow /ads.txt
Disallow /admin/
Disallow /n_news/

googlebot

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

googlebot-news

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

googlebot-image

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

mediapartners-google

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

google search console

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

googlebot/2.1

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

googlebot-smartphone

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

googlebot-mobile

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

bingbot

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

msnbot

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

bingpreview

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

naverbot

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

facebot

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

facebookexternalhit/1.1

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

twitterbot

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

yeti

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

daumoa

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

daum

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

daumwebmastertool

Rule Path
Allow /
Allow /pollList.html
Allow /pollVoteForm.html
Allow /pollResult_ing.html
Allow /pollResult.html
Allow /pollArticleList.html
Disallow /admin/
Disallow /n_news/

ahrefsbot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

zitebot

Rule Path
Disallow /

umbot-ln

Rule Path
Disallow /

ru_bot

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

kraken

Rule Path
Disallow /

superfeedr bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.topstarnews.net/sitemap.xml
sitemap https://www.topstarnews.net/sitemap-index.xml

Comments

  • Robots for topsinger.topstarnews.net
  • Other Bot, crawlers all disallow
  • SiteMap
  • DaumWebMasterTool:05de4cc3fe5fad6426a2aace43782d49211cf286eeb4d48175595684329226be:xjc60NJ+23sJkTGGRLnC4A==