xaluanvnn.com
robots.txt

Robots Exclusion Standard data for xaluanvnn.com

Resource Scan

Scan Details

Site Domain xaluanvnn.com
Base Domain xaluanvnn.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-04-08T22:20:54+00:00
Next Scan 2024-07-07T22:20:54+00:00

Last Successful Scan

Scanned2022-06-25T09:45:30+00:00
URL https://xaluanvnn.com/robots.txt
Redirect https://www.xaluanvnn.com/robots.txt
Redirect Domain www.xaluanvnn.com
Redirect Base xaluanvnn.com
Response IP 123.30.129.234
Found Yes
Hash 46974f8ae7777b1235f06fd51b7ebf6b970cb0a49c1d9d275f8ba9c512b9f5f8
SimHash 4c60d4d1c637

Groups

*

Rule Path
Disallow *marticle*
Disallow *xl_*
Disallow *XL_*
Disallow *iarss*
Disallow *xaluan.net*
Disallow *xaluan.info*
Disallow *xaluan.org*
Disallow *us.xaluan.com*
Disallow *xaluan.mobi*
Disallow /admin.php
Disallow /admin/
Disallow *xaluano*
Disallow *includes*
Disallow */modules/*
Disallow */opx/*
Disallow /blocks/
Disallow /Tag/
Disallow /tv/
Disallow /vnhits/
Disallow /downloads/
Disallow /seodigger/
Disallow /language/
Disallow /index.php/*
Disallow /modules.php/*
Disallow /*cname*
Disallow /*.rss/*
Disallow /*.php/*
Disallow /*.html/*
Disallow *ad_click*
Disallow *%3Dhttp%3A*
Disallow *%3D*
Disallow *php*fb*
Disallow *usg%3D*
Disallow *url%3D*
Disallow *t%3D*
Disallow *qc%3D*
Disallow *start%3D*
Disallow *postorder%3D*
Disallow *postdays%3D*
Disallow *topicdays%3D*
Disallow */Hau-truong/*
Disallow */timnhanh/*
Disallow *detail*modules*
Disallow *forums*
Disallow *profile*
Disallow *posting*
Disallow *mode*
Disallow *qsearch*
Disallow *Your_Account*
Disallow *Private_Messages*
Disallow *showad*
Disallow *activate*
Disallow *edit*
Disallow *raovat/-2*
Disallow *raovat/-3*
Disallow *raovat/-4*
Disallow *raovat/-5*
Disallow *xzcal*
Disallow *reply*
Disallow *comment*
Disallow *reportabuse*
Disallow *cityid*
Disallow *adid*
Disallow *ads*.php*
Disallow *pay*
Disallow *mark*
Disallow *Members*
Disallow *groupcp*
Disallow *coppermine*
Disallow *Horoscopes*
Disallow *url*
Disallow *thold*
Disallow *page*
Disallow *print*
Disallow *search*
Disallow *previous*
Disallow *utm*
Disallow *next*
Disallow *highlight*
Disallow *contact*
Disallow *trangvang*
Disallow *opx*
Disallow *rmcache*
Disallow *events*
Disallow *page*
Disallow *psid*
Disallow *mail*
Disallow *lang*
Disallow *playflash*
Disallow *mobitopic*
Disallow *mcategory*
Disallow *mtopic*
Disallow *new_topic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *mobisetpref.php*
Disallow *hot*
Disallow /themes/
Disallow /*thumbs*
Allow /ads*.txt
Allow /themes/Zeonix/
Allow */modules/News/comnews.php*
Disallow /*thumbs*
Disallow /*templates/*
Disallow /*themes/*
Disallow /videos/files/*
Disallow /*.mp4$
Disallow /images/news/Image/*xsmall_*img.*
Disallow /images/news/Image/*small_*img.*
Disallow /images/news/Image/*med_*img.*
Disallow /*?url=*
Disallow /images/news/Image/*

googlebot-mobile

Rule Path
Disallow *mobitopic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *hot*

Other Records

Field Value
sitemap /home.rss

Comments

  • Disallow: /
  • but allow only important bots #this for SUB.xaluan.com robots_dev.txt
  • User-agent: Googlebot
  • User-agent: Googlebot-Image
  • User-agent: Mediapartners-Google
  • User-agent: msnbot-media
  • User-agent: Slurp
  • User-agent: Yahoo-Blogs
  • User-agent: Yahoo-MMCrawler
  • User-agent: facebookexternalhit
  • User-agent: Facebot
  • Directories
  • Disallow: *font*
  • Sitemap: http://www.xaluan.com/mobile.rss
  • User-Agent: Googlebot-Image
  • Allow: /images/news/Image/*.img.*

Warnings

  • 1 invalid line.