Log In Sign Up

todotaller.cl
robots.txt

Robots Exclusion Standard data for todotaller.cl

Resource Scan

Scan Details

Site Domain todotaller.cl
Base Domain todotaller.cl
Scan Status Ok
Last Scan2025-11-28T00:40:51+00:00
Next Scan 2025-12-28T00:40:51+00:00

Last Scan

Scanned2025-11-28T00:40:51+00:00
URL https://todotaller.cl/robots.txt
Redirect https://www.todotaller.cl/robots.txt
Redirect Domain www.todotaller.cl
Redirect Base todotaller.cl
Domain IPs 3.217.181.114, 44.220.101.65
Redirect IPs 3.217.181.114, 44.220.101.65
Response IP 3.217.181.114
Found Yes
Hash 2bb2a3bb7b48a131565e026ebd7a6b2190dd5a1554a562f988ec971316da92c1
SimHash 41bc5840c7d5

Groups

googlebot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

googlebot-image

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

googlebot-video

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

googlenot-news

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

mediapartners-google

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

adsbot-google

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

adsbot-google-mobile

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

adsbot-google-mobile-apps

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

storebot-google

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

bingbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

applebot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

facebookexternalhit

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

twitterbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

linkedinbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

pinterestbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

ia_archiver

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

rogerbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

dotbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

gptbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

chatgpt-user

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

ccbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

claudebot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

google-extended

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

perplexitybot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

applebot-extended

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

*

Rule Path
Allow /$
Disallow /

Other Records

Field Value
crawl-delay 120
Back to top

Other Records

Field Value
sitemap https://www.todotaller.cl/sitemap.xml
Back to top

Comments

  • @Bsale 2025
  • Buscadores
  • Redes Sociales
  • Marketing Robots
  • Bots de Inteligencia Artificial
  • Resto de agentes sólo el home
  • Sitemap
Back to top