eldiariomontanes.es
robots.txt

Robots Exclusion Standard data for eldiariomontanes.es

Resource Scan

Scan Details

Site Domain eldiariomontanes.es
Base Domain eldiariomontanes.es
Scan Status Ok
Last Scan2024-11-09T21:06:04+00:00
Next Scan 2024-11-16T21:06:04+00:00

Last Scan

Scanned2024-11-09T21:06:04+00:00
URL https://eldiariomontanes.es/robots.txt
Redirect https://www.eldiariomontanes.es/robots.txt
Redirect Domain www.eldiariomontanes.es
Redirect Base eldiariomontanes.es
Domain IPs 23.32.29.11, 96.17.180.50
Redirect IPs 23.32.29.11, 96.17.180.50
Response IP 96.17.180.50
Found Yes
Hash 278b67911d2a9a88e1bb5b64fbabbbff357097938ce9d2343fd2e3993faf8556
SimHash a42c9c744271

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

twitterbot

Rule Path
Disallow *

*

Rule Path
Disallow /acd/
Disallow /fcgi-bin/
Disallow /registro/
Disallow /popups/
Disallow /*preview.html
Disallow /preview/
Disallow /_catalogo/
Disallow /*?ns_
Allow /eltiempo/cantabria/
Disallow /_cabeceraExterna/
Disallow /_config/
Disallow /externo/
Disallow /externos/
Disallow /includes/
Disallow /_minicabecera/
Disallow /metas.html/
Disallow /MM/
Disallow /modulos/
Disallow /_otrasConfiguraciones/
Disallow /RC/
Disallow /SysConfig/
Disallow /_webmasters/
Disallow /4900/vocento.eldiariomontanes/
Disallow /zHomePrueba/index.html
Disallow /pruebaspubli.html
Disallow /diario_montanes/MM/
Disallow /diario_montanes/noticias/
Disallow /apoyos/documentos/
Disallow /gl-d/
Disallow */gl-d$
Disallow /ht-d/
Disallow */ht-d$
Disallow /bb-d/
Disallow */bb-d$
Disallow /eltiempo/
Disallow /4900/webm.DIARIOMONTANES/
Disallow /backend/
Disallow /interactivo/
Disallow /module-amp/
Disallow */aggregate*
Disallow */multimedia/fotos/
Disallow */pg*/prensa/
Disallow */planes/2016
Disallow */prensa/
Disallow /guia-tv/*
Disallow */2006*
Disallow */2007*
Disallow */2008*
Disallow */2009*
Disallow */2010*
Disallow */2011*
Disallow */2012*
Disallow */2013*
Disallow */2014*
Disallow */2015*
Disallow /hemeroteca/*.html
Disallow *-mm.html

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.eldiariomontanes.es/sitemap.xml
sitemap https://www.eldiariomontanes.es/sitemap.incremental.xml
sitemap https://www.eldiariomontanes.es/sitemap-video.xml
sitemap https://www.eldiariomontanes.es/sitemap-temas.xml

Comments

  • User Agents
  • redi14
  • mobile
  • temp
  • Sitemaps