lasprovincias.com
robots.txt

Robots Exclusion Standard data for lasprovincias.com

Resource Scan

Scan Details

Site Domain lasprovincias.com
Base Domain lasprovincias.com
Scan Status Ok
Last Scan2024-11-10T20:27:17+00:00
Next Scan 2024-11-17T20:27:17+00:00

Last Scan

Scanned2024-11-10T20:27:17+00:00
URL http://lasprovincias.com/robots.txt
Redirect https://www.lasprovincias.es/robots.txt
Redirect Domain www.lasprovincias.es
Redirect Base lasprovincias.es
Domain IPs 34.111.196.5
Redirect IPs 23.32.29.11, 96.17.180.50
Response IP 23.32.29.11
Found Yes
Hash 2026da3073e2aab6504869a5e507f565ede3111c0337e2a0b86ec74a61591bd1
SimHash a920983a7271

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

twitterbot

Rule Path
Disallow *

*

Rule Path
Disallow /acd/
Disallow /prensa/
Allow /*/la-columna/
Disallow */registro/
Disallow */popups
Disallow /*preview.html
Disallow /preview/
Disallow /_catalogo/
Disallow /includes/manuales/_catalogo/
Disallow /zHomePrueba/index.html
Disallow /pruebaspubli.html
Allow /RC/*/Media/
Disallow /_cabeceraExterna/
Disallow /_config/
Disallow /img/
Disallow /includes/
Disallow /metas.html
Disallow /_minicabecera/
Disallow /MM/
Disallow /modulos/
Disallow /nullmetas.html
Disallow /RC/
Disallow /SysConfig/
Disallow /4900/vocento.lasprovincias/
Disallow /4900/webm.LASPROVINCIAS/
Disallow /la_verdad/noticias/
Disallow /apoyos/documentos/
Disallow */gl-d/
Disallow /*/gl-d$
Disallow */ht-d/
Disallow /*/ht-d$
Disallow */bb-d/
Disallow /*/bb-d$
Disallow /*?ns_
Disallow /embargadas/
Disallow /modgen/
Disallow */includes/2014/
Disallow /module-amp/
Disallow */multimedia/fotos/
Disallow */pg*/prensa/
Disallow */planes/2016
Disallow */aggregate*
Disallow */eurocopa/*-2016/*
Disallow /la_verdad/*
Disallow /las_provincias/*
Disallow /las_provincias_2017/*
Disallow */2006*
Disallow */2007*
Disallow */2008*
Disallow */2009*
Disallow */2010*
Disallow */2011*
Disallow */2012*
Disallow */2013*
Disallow /elecciones/generales/resultados/201*
Disallow */podcast/?pag=*
Disallow /backend/
Disallow /hemeroteca/*.html
Disallow */prensa/

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.lasprovincias.es/sitemap.xml
sitemap https://www.lasprovincias.es/sitemap.incremental.xml
sitemap https://www.lasprovincias.es/sitemap-video.xml
sitemap https://www.lasprovincias.es/sitemap-temas.xml

Comments

  • User Agents
  • Sitemaps