sien.es
robots.txt

Robots Exclusion Standard data for sien.es

Resource Scan

Scan Details

Site Domain sien.es
Base Domain sien.es
Scan Status Ok
Last Scan2025-11-29T04:35:02+00:00
Next Scan 2025-12-06T04:35:02+00:00

Last Scan

Scanned2025-11-29T04:35:02+00:00
URL https://sien.es/robots.txt
Domain IPs 104.21.21.149, 172.67.199.36, 2606:4700:3031::ac43:c724, 2606:4700:3035::6815:1595
Response IP 172.67.199.36
Found Yes
Hash 5468e31b32e2e34a2fc15879675d888e94c469cdf308b05cf574d5b42acc2e83
SimHash 65be4502d6b5

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

viberbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandex

Rule Path
Disallow /

applebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

discordbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

google-xrawler

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

google-structured-data-testing-tool

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

google-extended

Rule Path
Allow /

gptbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

naverbot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /

seznambot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

telegrambot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yeti

Rule Path
Allow /

validator.nu

Rule Path
Allow /

*

Rule Path
Disallow /
Allow /$
Disallow /*%5B?&%5Dref=
Disallow /*%5B?&%5Dtag=
Disallow /*%5B?&%5Dmarca=
Disallow /*%5B?&%5Dnodo=
Disallow /*%5B?&%5Dflag=
Disallow /cdn-cgi/
Disallow /comprar/
Disallow /search/
Disallow /api/
Disallow /lib/
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /*stores/
Disallow /*/c/
Disallow /*/comments/
Disallow /*/liked_by/
Disallow /*SID%3D
Disallow /*.php$

Other Records

Field Value
sitemap https://sien.es/sitemaps/sien.es/index.xml

Comments

  • ROBOTS.TXT ES
  • 20250803
  • Bloquear bots no deseados
  • Permitir Googlebots y otros bots útiles
  • Resto de bots (por defecto)
  • Sitemaps
  • Bloqueos por carpetas o parámetros