Log In Sign Up

xaluan.com
robots.txt

Robots Exclusion Standard data for xaluan.com

Resource Scan

Scan Details

Site Domain xaluan.com
Base Domain xaluan.com
Scan Status Ok
Last Scan2024-11-12T16:28:09+00:00
Next Scan 2024-11-19T16:28:09+00:00

Last Scan

Scanned2024-11-12T16:28:09+00:00
URL https://xaluan.com/robots.txt
Redirect https://www.xaluan.com/robots.txt
Redirect Domain www.xaluan.com
Redirect Base xaluan.com
Domain IPs 104.21.67.198, 172.67.180.38, 2606:4700:3035::ac43:b426, 2606:4700:3037::6815:43c6
Redirect IPs 104.21.67.198, 172.67.180.38, 2606:4700:3035::ac43:b426, 2606:4700:3037::6815:43c6
Response IP 172.67.180.38
Found Yes
Hash 78e9a76d8c448d85bf235e7f59a80cb7c1415d759a1cb59ecad40aba0cce3a30
SimHash 4e60ccd1c6b7

Groups

*

Rule Path
Disallow *xl_*
Disallow *XL_*
Disallow *iarss*
Disallow *xaluan.net*
Disallow *xaluan.info*
Disallow *xaluan.org*
Disallow *xaluan.mobi*
Disallow *us.xaluan.com*
Disallow /admin.php
Disallow /admin/
Disallow *xaluano*
Disallow *includes*
Disallow */modules/*
Disallow */opx/*
Disallow /blocks/
Disallow /Tag/
Disallow /tv/
Disallow /vnhits/
Disallow /downloads/
Disallow /seodigger/
Disallow /language/
Disallow /index.php/*
Disallow /modules.php/*
Disallow /*cname*
Disallow /*.php/*
Disallow /*.html/*
Disallow *ad_click*
Disallow *%3Dhttp%3A*
Disallow *%3D*
Disallow *php*fb*
Disallow *usg%3D*
Disallow *url%3D*
Disallow *t%3D*
Disallow *qc%3D*
Disallow *start%3D*
Disallow *postorder%3D*
Disallow *postdays%3D*
Disallow *topicdays%3D*
Disallow */Hau-truong/*
Disallow */timnhanh/*
Disallow *detail*modules*
Disallow *forums*
Disallow *profile*
Disallow *posting*
Disallow *mode*
Disallow *qsearch*
Disallow *Your_Account*
Disallow *Private_Messages*
Disallow *showad*
Disallow *activate*
Disallow *edit*
Disallow *raovat/-2*
Disallow *raovat/-3*
Disallow *raovat/-4*
Disallow *raovat/-5*
Disallow *xzcal*
Disallow *reply*
Disallow *comment*
Disallow *reportabuse*
Disallow *cityid*
Disallow *adid*
Disallow *ads*.php*
Disallow *pay*
Disallow *mark*
Disallow *Members*
Disallow *groupcp*
Disallow *coppermine*
Disallow *Horoscopes*
Disallow *url*
Disallow *thold*
Disallow *page*
Disallow *print*
Disallow *search*
Disallow *previous*
Disallow *?utm*
Disallow *next*
Disallow *highlight*
Disallow *contact*
Disallow *trangvang*
Disallow *opx*
Disallow *rmcache*
Disallow *events*
Disallow *page*
Disallow *psid*
Disallow *mail*
Disallow *lang*
Disallow *playflash*
Disallow *mobitopic*
Disallow *mcategory*
Disallow *mtopic*
Disallow *new_topic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *mobisetpref.php*
Disallow *hot*
Disallow /themes/
Disallow /*thumbs*
Disallow /themes/Zeonix/
Disallow */modules/News/comnews.php*
Allow /ads*.txt
Disallow /*thumbs*
Disallow /*templates/*
Disallow /*themes/*
Disallow /videos/files/*
Disallow /*.mp4$
Disallow /images/news/Image/*xsmall_*img.*
Disallow /images/news/Image/*small_*img.*
Disallow /images/news/Image/*med_*img.*
Disallow /*?url=*
Allow /images/news/Image/*.img.*

googlebot-mobile

Rule Path
Disallow *mobitopic*
Disallow *article_mobi*
Disallow *mobi.php*
Disallow *hot*
Back to top

Comments

  • Disallow: /
  • but allow only important bots #this for www.xaluan.com robots_xl.txt
  • User-agent: Googlebot
  • User-agent: Googlebot-Image
  • User-agent: Mediapartners-Google
  • User-agent: msnbot-media
  • User-agent: Slurp
  • User-agent: Yahoo-Blogs
  • User-agent: Yahoo-MMCrawler
  • User-agent: facebookexternalhit
  • User-agent: Facebot
  • Directories
  • Disallow: /*.rss/*
  • Disallow: *font*
  • Sitemap: /home.rss
  • Sitemap: http://www.xaluan.com/mobile.rss
  • User-Agent: Googlebot-Image
  • Disallow: /images/news/Image/*
Back to top

Warnings

  • 1 invalid line.
Back to top