trangtinmoi.net
robots.txt

Robots Exclusion Standard data for trangtinmoi.net

Resource Scan

Scan Details

Site Domain trangtinmoi.net
Base Domain trangtinmoi.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-08T21:54:24+00:00
Next Scan 2024-07-07T21:54:24+00:00

Last Successful Scan

Scanned2022-02-12T15:53:15+00:00
URL http://trangtinmoi.net/robots.txt
Redirect http://www.trangtinmoi.net/robots.txt
Redirect Domain www.trangtinmoi.net
Redirect Base trangtinmoi.net
Response IP 123.30.129.234
Found Yes
Hash b5266281c72c61c558cd3f1e27f5a5125741ccf3cb74b487aa65b8ec49eb3997
SimHash 4c60d9d146b5

Groups

*

Rule Path
Disallow *marticle*
Disallow *xl_*
Disallow *XL_*
Disallow *iarss*
Disallow *xaluan.net*
Disallow *xaluan.info*
Disallow *xaluan.org*
Disallow *us.xaluan.com*
Disallow *xaluan.mobi*
Disallow /admin.php
Disallow /admin/
Disallow *xaluano*
Disallow *includes*
Disallow */modules/*
Disallow */opx/*
Disallow /blocks/
Disallow /Tag/
Disallow /tv/
Disallow /vnhits/
Disallow /downloads/
Disallow /seodigger/
Disallow /language/
Disallow /index.php/*
Disallow /modules.php/*
Disallow /*cname*
Disallow /*.rss/*
Disallow /*.php/*
Disallow /*.html/*
Disallow *ad_click*
Disallow *%3Dhttp%3A*
Disallow *%3D*
Disallow *php*fb*
Disallow *usg%3D*
Disallow *url%3D*
Disallow *t%3D*
Disallow *qc%3D*
Disallow *start%3D*
Disallow *postorder%3D*
Disallow *postdays%3D*
Disallow *topicdays%3D*
Disallow */Hau-truong/*
Disallow */timnhanh/*
Disallow *detail*modules*
Disallow *forums*
Disallow *profile*
Disallow *posting*
Disallow *mode*
Disallow *qsearch*
Disallow *Your_Account*
Disallow *Private_Messages*
Disallow *showad*
Disallow *activate*
Disallow *edit*
Disallow *raovat/-2*
Disallow *raovat/-3*
Disallow *raovat/-4*
Disallow *raovat/-5*
Disallow *xzcal*
Disallow *reply*
Disallow *comment*
Disallow *reportabuse*
Disallow *cityid*
Disallow *adid*
Disallow *ads*.php*
Disallow *pay*
Disallow *mark*
Disallow *Members*
Disallow *groupcp*
Disallow *coppermine*
Disallow *Horoscopes*
Disallow *url*
Disallow *thold*
Disallow *page*
Disallow *print*
Disallow *search*
Disallow *previous*
Disallow *utm*
Disallow *next*
Disallow *highlight*
Disallow *contact*
Disallow *trangvang*
Disallow *opx*
Disallow *rmcache*
Disallow *events*
Disallow *page*
Disallow *psid*
Disallow *mail*
Disallow *lang*
Disallow *playflash*
Disallow *mobitopic*
Disallow *mcategory*
Disallow *mtopic*
Disallow *new_topic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *mobisetpref.php*
Disallow *hot*
Disallow /themes/
Disallow /*thumbs*
Allow /ads*.txt
Allow /themes/Zeonix/
Allow */modules/News/comnews.php*
Disallow /*thumbs*
Disallow /*templates/*
Disallow /*themes/*
Disallow /videos/files/*
Disallow /*.mp4$
Disallow /images/news/Image/*xsmall_*img.jpg$
Disallow /images/news/Image/*small_*img.jpg$
Disallow /images/news/Image/*med_*img.jpg$
Disallow /*?url=*
Disallow /images/news/Image/*

googlebot-mobile

Rule Path
Disallow *mobitopic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *hot*

Other Records

Field Value
sitemap http://www.xaluan.com/Home.rss

Comments

  • Disallow: /
  • but allow only important bots #this for SUB.xaluan.com robots_dev.txt
  • User-agent: Googlebot
  • User-agent: Googlebot-Image
  • User-agent: Mediapartners-Google
  • User-agent: msnbot-media
  • User-agent: Slurp
  • User-agent: Yahoo-Blogs
  • User-agent: Yahoo-MMCrawler
  • User-agent: facebookexternalhit
  • User-agent: Facebot
  • Directories
  • Disallow: *font*
  • Sitemap: http://www.xaluan.com/mobile.rss
  • User-Agent: Googlebot-Image
  • Allow: /images/news/Image/*.img.jpg$

Warnings

  • 1 invalid line.