xaluanvn.com
robots.txt

Robots Exclusion Standard data for xaluanvn.com

Resource Scan

Scan Details

Site Domain xaluanvn.com
Base Domain xaluanvn.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-04-08T19:18:51+00:00
Next Scan 2024-07-07T19:18:51+00:00

Last Successful Scan

Scanned2022-02-08T01:26:06+00:00
URL http://xaluanvn.com/robots.txt
Redirect http://www.xaluanvn.com/robots.txt
Redirect Domain www.xaluanvn.com
Redirect Base xaluanvn.com
Response IP 123.30.129.234
Found Yes
Hash b5266281c72c61c558cd3f1e27f5a5125741ccf3cb74b487aa65b8ec49eb3997
SimHash 4c60d9d146b5

Groups

*

Rule Path
Disallow *marticle*
Disallow *xl_*
Disallow *XL_*
Disallow *iarss*
Disallow *xaluan.net*
Disallow *xaluan.info*
Disallow *xaluan.org*
Disallow *us.xaluan.com*
Disallow *xaluan.mobi*
Disallow /admin.php
Disallow /admin/
Disallow *xaluano*
Disallow *includes*
Disallow */modules/*
Disallow */opx/*
Disallow /blocks/
Disallow /Tag/
Disallow /tv/
Disallow /vnhits/
Disallow /downloads/
Disallow /seodigger/
Disallow /language/
Disallow /index.php/*
Disallow /modules.php/*
Disallow /*cname*
Disallow /*.rss/*
Disallow /*.php/*
Disallow /*.html/*
Disallow *ad_click*
Disallow *%3Dhttp%3A*
Disallow *%3D*
Disallow *php*fb*
Disallow *usg%3D*
Disallow *url%3D*
Disallow *t%3D*
Disallow *qc%3D*
Disallow *start%3D*
Disallow *postorder%3D*
Disallow *postdays%3D*
Disallow *topicdays%3D*
Disallow */Hau-truong/*
Disallow */timnhanh/*
Disallow *detail*modules*
Disallow *forums*
Disallow *profile*
Disallow *posting*
Disallow *mode*
Disallow *qsearch*
Disallow *Your_Account*
Disallow *Private_Messages*
Disallow *showad*
Disallow *activate*
Disallow *edit*
Disallow *raovat/-2*
Disallow *raovat/-3*
Disallow *raovat/-4*
Disallow *raovat/-5*
Disallow *xzcal*
Disallow *reply*
Disallow *comment*
Disallow *reportabuse*
Disallow *cityid*
Disallow *adid*
Disallow *ads*.php*
Disallow *pay*
Disallow *mark*
Disallow *Members*
Disallow *groupcp*
Disallow *coppermine*
Disallow *Horoscopes*
Disallow *url*
Disallow *thold*
Disallow *page*
Disallow *print*
Disallow *search*
Disallow *previous*
Disallow *utm*
Disallow *next*
Disallow *highlight*
Disallow *contact*
Disallow *trangvang*
Disallow *opx*
Disallow *rmcache*
Disallow *events*
Disallow *page*
Disallow *psid*
Disallow *mail*
Disallow *lang*
Disallow *playflash*
Disallow *mobitopic*
Disallow *mcategory*
Disallow *mtopic*
Disallow *new_topic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *mobisetpref.php*
Disallow *hot*
Disallow /themes/
Disallow /*thumbs*
Allow /ads*.txt
Allow /themes/Zeonix/
Allow */modules/News/comnews.php*
Disallow /*thumbs*
Disallow /*templates/*
Disallow /*themes/*
Disallow /videos/files/*
Disallow /*.mp4$
Disallow /images/news/Image/*xsmall_*img.jpg$
Disallow /images/news/Image/*small_*img.jpg$
Disallow /images/news/Image/*med_*img.jpg$
Disallow /*?url=*
Disallow /images/news/Image/*

googlebot-mobile

Rule Path
Disallow *mobitopic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *hot*

Other Records

Field Value
sitemap http://www.xaluan.com/Home.rss

Comments

  • Disallow: /
  • but allow only important bots #this for SUB.xaluan.com robots_dev.txt
  • User-agent: Googlebot
  • User-agent: Googlebot-Image
  • User-agent: Mediapartners-Google
  • User-agent: msnbot-media
  • User-agent: Slurp
  • User-agent: Yahoo-Blogs
  • User-agent: Yahoo-MMCrawler
  • User-agent: facebookexternalhit
  • User-agent: Facebot
  • Directories
  • Disallow: *font*
  • Sitemap: http://www.xaluan.com/mobile.rss
  • User-Agent: Googlebot-Image
  • Allow: /images/news/Image/*.img.jpg$

Warnings

  • 1 invalid line.