elcorreodigital.com
robots.txt

Robots Exclusion Standard data for elcorreodigital.com

Resource Scan

Scan Details

Site Domain elcorreodigital.com
Base Domain elcorreodigital.com
Scan Status Ok
Last Scan2024-11-15T10:24:41+00:00
Next Scan 2024-11-22T10:24:41+00:00

Last Scan

Scanned2024-11-15T10:24:41+00:00
URL http://elcorreodigital.com/robots.txt
Redirect https://www.elcorreo.com/robots.txt
Redirect Domain www.elcorreo.com
Redirect Base elcorreo.com
Domain IPs 34.111.196.5
Redirect IPs 23.209.46.159, 23.209.46.162
Response IP 23.44.4.139
Found Yes
Hash 547924c718a03e48efbc77b0bdd287e8cd566cad24a366bcc88cb1230bd0a259
SimHash a13099725971

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

twitterbot

Rule Path
Disallow *

grapeshot

Rule Path
Allow *2020*

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /acd/
Disallow /fcgi-bin/
Disallow /*preview.html
Disallow */prensa/
Disallow /includes/manuales
Disallow /encuestas/encuesta.php
Disallow /registro/
Disallow /interactivo/comun/contactar.html
Disallow /interactivo/comun/condiciones.html
Disallow /interactivo/comun/privacidad.html
Disallow /interactivo/comun/publicidad.html
Disallow /popups/
Disallow /agencias/*/0$
Disallow /final-copa-del-rey/
Disallow /preview/
Disallow /_catalogo/
Disallow /includes/manuales/_catalogo/
Disallow /*?ns_
Allow /img/
Allow /RC/*/Media/
Allow /eltiempo/pais-vasco/vizcaya/
Allow /eltiempo/pais-vasco/alava/
Disallow /_cabeceraExterna/
Disallow /_config/
Disallow /externo/
Disallow /includes/
Disallow /metas.html
Disallow /_minicabecera/
Disallow /nullmetas.html
Disallow /MM/
Disallow /modulos/
Disallow /_otrasConfiguraciones/
Disallow /RC/
Disallow /MSN/
Disallow /SysConfig/
Disallow /4900/vocento.elcorreodigital/
Disallow /4900/webm.ELCORREO/
Disallow /zHomePrueba/index.html
Disallow /pruebaspubli.html
Disallow /eltiempo/
Disallow /apoyos/documentos/
Disallow /module-amp/
Disallow */aggregate*
Disallow */multimedia/fotos/
Disallow */pg*/prensa/
Disallow */planes/2014
Disallow */planes/2016
Disallow /backend/
Disallow /hemeroteca/*.html

chatgpt-user

Rule Path
Disallow /
Disallow /backend/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elcorreo.com/sitemap.xml
sitemap https://www.elcorreo.com/sitemap.incremental.xml
sitemap https://www.elcorreo.com/sitemap-video.xml
sitemap https://www.elcorreo.com/sitemap-temas.xml

Comments

  • Robots www.elcorreo.com
  • User Agents
  • redi2014
  • temp
  • 25/10/17
  • Sitemaps