tuandco.com
robots.txt

Robots Exclusion Standard data for tuandco.com

Resource Scan

Scan Details

Site Domain tuandco.com
Base Domain tuandco.com
Scan Status Ok
Last Scan2024-09-25T09:58:57+00:00
Next Scan 2024-10-25T09:58:57+00:00

Last Scan

Scanned2024-09-25T09:58:57+00:00
URL https://tuandco.com/robots.txt
Redirect https://www.tuandco.com/robots.txt
Redirect Domain www.tuandco.com
Redirect Base tuandco.com
Domain IPs 151.101.1.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.45.124
Found Yes
Hash 5120dd209b4766ba4388b3a5069bff92feca175740f81c2f33e932b654594db4
SimHash e33f7211caf1

Groups

*

Rule Path
Disallow /js/mage/cookies.js
Disallow /js/prodfaqs/Modalbox/modalbox.js
Disallow /add
Disallow /addAjax
Disallow /catalog/product/upload/
Disallow /turpentine
Disallow /page/
Disallow /*?largo_filtrable=*
Disallow /*?idPrevPage=*
Disallow /*?diametro_salida_humos=*
Disallow /*?medida_piscina=*
Disallow /*?brands=*
Disallow /*?modelo_accesorios_bano=*
Disallow /*?mc_cid=*
Disallow /*?color=*
Disallow /*%26color%3D*
Disallow /wishlist/
Disallow /autorresponder/
Disallow /*aggregate
Disallow /*downloads/dl/updateDownloads*
Disallow /*?q=
Disallow /*search
Disallow /*captcha
Disallow /*cookiepolicy
Disallow /*updatesession
Disallow /*is/?f=*
Disallow /*include/*
Disallow /vian_design/
Disallow /distribuidora-draft
Disallow /home-aniversario-draft
Disallow /promociones-y-cupones-draft
Allow /*?belboon*
Allow /*%26belboon*
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /magento/
Disallow /captcha/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /stats/
Disallow /var/
Disallow /catalog/product_compare/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /catalog/product/gallery/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /*.php$
Disallow /*?SID=
Disallow /*.inc$

compspybot
curious george
cybeye.com
daumoa
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
gsa-crawler
httrack
lexxebot
libcrawl
libwww
linkdex
lwnutch
magpie-crawler
microsoft.url.control
msiecrawler
openwebindex
rediffnewsbot
repparser
rogerbot
scanmine
screaming frog seo spider
seoengworldbot
shopwiki
showyoubot
sindice-site-manager
sogou
sogou spider
sosospider
webcopier
wocbot
woriobot
yacybot
yeti
yolinkbot
youdaobot
scanmine
quanta-probe

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.tuandco.com/media/sitemap.xml
sitemap https://www.tuandco.com/aprendeymejora/category-sitemap.xml
sitemap https://www.tuandco.com/aprendeymejora/post-sitemap.xml

Comments

  • Custom
  • Disallow: /*,*
  • Disallow: /*?idRecommendation=*
  • Disallow: /aprendeymejora/comment-subscriptions/
  • Disallow: /*srsrc*
  • Disallow: /*srp*
  • Disallow: /*sra*
  • Disallow: /*srk*
  • Disallow: /*sort-by*
  • Disallow: /*show/*
  • Disallow: /*sort-direction*
  • Disallow: /*aprendeymejora/tag/*
  • Disallow: /*?ver-todos
  • Disallow: /*&ver-todos
  • Directories
  • Paths (clean URLs)
  • Disallow: /catalog/category/view/
  • Disallow: /catalog/product/view/
  • Disallow: /customer/
  • Files
  • Paths (no clean URLs)