elespectador.com
robots.txt

Robots Exclusion Standard data for elespectador.com

Resource Scan

Scan Details

Site Domain elespectador.com
Base Domain elespectador.com
Scan Status Ok
Last Scan2024-11-13T06:03:34+00:00
Next Scan 2024-11-20T06:03:34+00:00

Last Scan

Scanned2024-11-13T06:03:34+00:00
URL https://elespectador.com/robots.txt
Redirect https://www.elespectador.com/robots.txt
Redirect Domain www.elespectador.com
Redirect Base elespectador.com
Domain IPs 23.209.46.90, 23.209.46.97, 2600:1413:b000:13::b857:c184, 2600:1413:b000:13::b857:c193
Redirect IPs 23.209.46.17, 23.209.46.9, 2600:1413:b000:13::b857:c184, 2600:1413:b000:13::b857:c193
Response IP 23.45.207.178
Found Yes
Hash 9a19a7955df80ed3bee1d5a7cea46a9a34a5a99f8d6a77c19090df03db55bc02
SimHash bcd45ad0aef4

Groups

*

Rule Path
Allow /

*

Rule Path
Allow /resources/*.css$
Allow /resources/*.scss$
Allow /resources/*.js$
Allow /resources/*.jpg
Allow /resources/*.jpeg
Allow /resources/*.png
Allow /resources/*.svg
Disallow /admin/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /jscroll_view_entity/
Disallow /ee-comments-services/
Disallow /taxonomy/
Disallow /files/
Disallow /pf/api/v3/*
Disallow /pf/api/v3/*
Disallow /noticias/bogota/marco-fidel-ramirez-debe-expulsar-a-asesor-que-agredio-a-su-novia-2/
Disallow /bogota/marco-fidel-ramirez-debe-expulsar-a-asesor-que-agredio-a-su-novia-article-491781/
Disallow /noticias/bogota/periodista-agredida-por-exasesor-de-concejal-dice-que-siempre-le-tuvo-miedo-2/
Disallow /bogota/periodista-agredida-por-exasesor-de-concejal-dice-que-siempre-le-tuvo-miedo-article-492254/
Disallow /noticias/investigacion/el-top-10-de-los-casos-de-corrupcion-ad-portas-de-fallo/
Disallow /investigacion/el-top-10-de-los-casos-de-corrupcion-ad-portas-de-fallo-article-447582/
Disallow /noticias/bogota/atencion-a-las-mujeres-es-insuficiente/
Disallow /bogota/atencion-a-las-mujeres-es-insuficiente-article-491974/
Disallow /entretenimiento/musica/las-mejores-frases-bob-marley-en-su-dia-video-737643/
Disallow /colombia/mas-regiones/los-lios-de-adolfo-enrique-herrera-monsalve-article-367463/
Disallow /noticias/nacional/los-lios-de-adolfo-enrique-herrera-monsalve-video-367463/
Disallow /colombia/cartagena/a-empresario-condenado-por-estafa-le-siguen-adjudicando-contratos-del-estado-article-367475/
Disallow /judicial/denunciaron-por-fraude-procesal-a-jaime-lombana-abogado-de-alvaro-uribe-article/
Disallow /judicial/un-fraude-por-1-4-millones-de-dolares-article-638608/
Disallow /tags/lida-marcela-pedraza-quinche/
Disallow /judicial/un-fraude-por-1-4-millones-de-dolares-article-638608
Disallow /judicial/la-carta-que-enfrenta-a-tres-hombres-polemicos-article-152571/
Disallow /judicial/los-expedientes-engavetados-contra-los-hermanos-angel-article-891367/
Disallow /noticias/judicial/los-expedientes-engavetados-contra-los-hermanos-angel/
Disallow /bogota/atencion-a-las-mujeres-es-insuficiente-article-491974/
Disallow /bogota/marco-fidel-ramirez-debe-expulsar-a-asesor-que-agredio-a-su-novia-article-491781/
Disallow /bogota/periodista-agredida-por-exasesor-de-concejal-dice-que-siempre-le-tuvo-miedo-article-492254/
Disallow /judicial/los-hilos-sueltos-de-cuchillo-article-349042/
Disallow /contenido-patrocinado/pulso-por-la-alcaldia-de-medellin-fico-gutierrez-correa-y-upegui-marcan-la-pauta/
Disallow /contenido-patrocinado/atilano-giraldo-sin-contendor-en-la-proxima-eleccion-de-gobernador-en-quindio/
Disallow /contenido-patrocinado/pulso-por-la-alcaldia-de-bogota-galan-oviedo-bolivar-y-gaviria-marcan-la-pauta/
Disallow /contenido-patrocinado/elecciones-2023-medellin-en-vilo-y-luis-perez-lidera-en-antioquia/
Disallow /contenido-patrocinado/elecciones-2023-yahir-acuna-lidera-las-encuestas-en-sincelejo/
Disallow /contenido-patrocinado/si-hoy-fueran-las-elecciones-en-medellin-federico-gutierrez-seria-el-alcalde/
Disallow /contenido-patrocinado/dos-pesos-pesados-del-partido-liberal-se-disputan-la-alcaldia-de-bucaramanga/
Disallow /contenido-patrocinado/el-pulso-preelectoral-por-la-alcaldia-de-cartagena/
Disallow /comments/
Disallow /judicial/por-irrespetuosa-corte-pide-investigar-a-abogada-que-busca-impedir-el-aborto-article/
Disallow /actualidad/emprende-un-viaje-fascinante-desde-las-colosales-piramides-a-imponentes-fortalezas/
Disallow /judicial/investigaran-a-abelardo-de-la-espriella-por-presunto-enriquecimiento-ilicito-article-491238/
Disallow /judicial/investigaran-a-abelardo-de-la-espriella-por-presunto-enriquecimiento-ilicito-article-491238
Disallow /judicial/fiscalia-acuso-al-exministro-gustavo-adolfo-canal-por-peculado-article-337464/
Disallow /judicial/fiscalia-acuso-al-exministro-gustavo-adolfo-canal-por-peculado-article-337464
Disallow /judicial/por-peculado-ordenan-captura-del-exministro-gustavo-canal-article-308931/
Disallow /judicial/por-peculado-ordenan-captura-del-exministro-gustavo-canal-article-308931
Disallow /render-blocks/
Disallow /render-blocks
Disallow /judicial/me-siento-abandonada-y-perseguida-capitana-del-ejercito-acosada-article-882229/
Disallow /judicial/me-siento-abandonada-y-perseguida-capitana-del-ejercito-acosada-article-882229
Disallow /investigacion/las-pruebas-que-inculpan-a-orion-deep-el-influencer-detenido-por-delitos-sexuales/
Disallow /investigacion/las-pruebas-que-inculpan-a-orion-deep-el-influencer-detenido-por-delitos-sexuales

grapeshot

Rule Path
Disallow

petalbot

Rule Path
Allow

netseer

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

newsproxy.app

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elespectador.com/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.elespectador.com/arc/outboundfeeds/sitemap/?outputType=xml
sitemap https://www.elespectador.com/arc/outboundfeeds/video-index/?outputType=xml
sitemap https://www.elespectador.com/arc/outboundfeeds/video-sitemap/?outputType=xml
sitemap https://www.elespectador.com/arc/outboundfeeds/image-sitemap/?outputType=xml
sitemap https://www.elespectador.com/arc/outboundfeeds/news-sitemap/?outputType=xml
sitemap https://www.elespectador.com/arc/outboundfeeds/tags-sitemap/?outputType=xml

Comments

  • Sitemap:
  • CSS, JS, Images
  • Paths (clean URLs)
  • Content ARC
  • Content ARC
  • Remove request (clean URLs)