Log In Sign Up

lavanguardia.es
robots.txt

Robots Exclusion Standard data for lavanguardia.es

Resource Scan

Scan Details

Site Domain lavanguardia.es
Base Domain lavanguardia.es
Scan Status Ok
Last Scan2024-05-18T09:19:10+00:00
Next Scan 2024-05-25T09:19:10+00:00

Last Scan

Scanned2024-05-18T09:19:10+00:00
URL http://lavanguardia.es/robots.txt
Redirect https://www.lavanguardia.com/robots.txt
Redirect Domain www.lavanguardia.com
Redirect Base lavanguardia.com
Domain IPs 213.4.81.211, 88.87.219.211
Redirect IPs 184.30.14.179
Response IP 104.110.73.18
Found Yes
Hash 99f32c6e7752f580880ce268b1c33c93473a82439bc9c598ff035e49eb129e46
SimHash f313a9cdcef6

Groups

*

Rule Path
Allow /ads.txt
Allow /app-ads.txt
Disallow /temas/
Allow /temas/venezuela
Allow /temas/universo-africa
Allow /temas/thinkbig-empresas
Allow /temas/supermercados-dia
Allow /temas/sofia-gh-16
Allow /temas/relojes
Allow /temas/raquel-gh-16
Allow /temas/primitiva
Allow /temas/once
Allow /temas/nacidos-para-ser-autonomos-teoria
Allow /temas/nacidos-para-ser-autonomos-practica
Allow /temas/nacidos-para-ser-autonomos
Allow /temas/myhyv
Allow /temas/mercedes-martin
Allow /temas/loteria-nacional
Allow /temas/lorena-roldan
Allow /temas/lae
Allow /temas/junior-report-go
Allow /temas/junior-report-fp
Allow /temas/junior-report-coronavirus
Allow /temas/junior-report
Allow /temas/juanra-bonet
Allow /temas/jose-maria-gil-silgado
Allow /temas/jordi-gonzalez
Allow /temas/innovacion-tecnologia
Allow /temas/hablemos-de-futuro
Allow /temas/grandes-viajeros
Allow /temas/gran-hermano-vip
Allow /temas/futbol-club-barcelona
Allow /temas/europa-fact-checking
Allow /temas/euromillones
Allow /temas/estar-donde-estes
Allow /temas/eslaliga
Allow /temas/encuestas-elecciones-generales
Allow /temas/mirador-comunicacion-marketing
Allow /temas/elmiradordelacomunicacionyelmarketing
Allow /temas/elmiradordelacomunicacionyelmarketing/mk
Allow /temas/ecologia
Allow /temas/consorci-de-la-zona-franca
Allow /temas/ciudad-azul
Allow /temas/catalunya-futur
Allow /temas/carolina-sobe
Allow /temas/canal-andorra-ski
Allow /temas/canal-andorra-noticias
Allow /temas/canal-andorra-economia
Allow /temas/canal-andorra
Allow /temas/bonoloto
Allow /temas/bicentenario-del-museo-del-prado
Allow /temas/belen-esteban
Allow /temas/barcelona-tech-city
Allow /temas/back-market
Allow /temas/arenys-de-mar
Allow /temas/amor-romeira
Allow /temas/ahorro-para-la-jubilacion
Allow /temas/agrocultura
Allow /temas/adara-gh-17
Allow /temas/accidentes-de-trafico
Allow /temas/a-fondo
Allow /temas/eventos-la-vanguardia
Allow /temas/ciudades-en-movimiento
Allow /temas/ahorro-e-inversion
Allow /temas/en-mejora-continua
Allow /temas/todos-solidarios
Allow /temas/recuperar-barcelona
Disallow /web/
Disallow /premium/
Disallow /lv24h2007/
Disallow /cercadorgg/
Disallow /gen/
Disallow /cgi-bin/
Disallow /ajax/
Disallow /periodico/ajax/
Disallow /buscador/
Disallow /crossdomain.xml
Disallow /%2B*
Disallow /_hemeroteca/*
Disallow /mvc/*
Disallow /apps/*
Disallow /list/*
Disallow /inmo/
Disallow /loterias/loteria-navidad/buscar-numero/*
Disallow /loterias/loteria-navidad-amp/buscar-numero/*
Disallow /loterias/loteria-navidad-app/buscar-numero/*
Disallow /cartelera/peliculas/persona/
Disallow /politica/20081007/53556163832/
Disallow /sitemap-news-agencias-*.xml
Disallow /economia/20121003/54351571275/*
Disallow /loterias/loteria-navidad-2022/comprobar-loteria-navidad/*
Disallow /loterias/loteria-navidad-2022/buscar-numero/*
Disallow /motor/ocasion/*
Disallow /motor/coches/
Disallow /loterias/loteria-navidad/comprobar-numeros/*
Disallow /loterias/loteria-nino/comprobar-numeros/*
Disallow /arambee/
Disallow /loterias/loteria-nino-2022/comprobar-loteria-nino/numero-
Disallow /loterias/loteria-navidad/comprobar-loteria-navidad/
Disallow /loterias/loteria-navidad-amp/comprobar-loteria-navidad/
Disallow /loterias/loteria-navidad/lugares-agraciados/
Disallow /loterias/loteria-nino/comprobar-loteria-nino/
Disallow /loterias/loteria-nino-amp/comprobar-loteria-nino/
Disallow /loterias/loteria-navidad-2021/buscar-numero/*
Disallow /loterias/loteria-navidad-2021/comprobar-loteria-navidad/*
Disallow /elecciones/elecciones-municipales-2019/
Disallow /elecciones/autonomicas-cataluna-2021/
Disallow /elecciones/elecciones-generales-noviembre-2019/
Disallow /elecciones/autonomicas-madrid-2021/
Disallow /elecciones/elecciones-generales-2019/
Disallow /elecciones/autonomicas-galicia-2020/
Disallow /elecciones/autonomicas-pais-vasco-2020/
Disallow /elecciones/autonomicas-valencia-2019/
Disallow /elecciones/elecciones-europeas-2019/
Disallow /elecciones/autonomicas-castilla-y-leon-2019/
Disallow /elecciones/autonomicas-castilla-la-mancha-2019/
Disallow /elecciones/autonomicas-asturias-2019/
Disallow /elecciones/autonomicas-aragon-2019/
Disallow /elecciones/autonomicas-navarra-2019/
Disallow /elecciones/autonomicas-extremadura-2019/
Disallow /elecciones/autonomicas-baleares-2019/
Disallow /elecciones/elecciones-catalanas-2017/
Disallow /elecciones/autonomicas-region-de-murcia-2019/
Disallow /elecciones/autonomicas-canarias-2019/
Disallow /elecciones/autonomicas-madrid-2019/
Disallow /elecciones/elecciones-europeas-2019/
Disallow /elecciones/elecciones-municipales-2019/
Disallow /elecciones/autonomicas-cataluna-2021/
Disallow /elecciones/elecciones-generales-noviembre-2019/
Disallow /elecciones/autonomicas-madrid-2021/
Disallow /elecciones/elecciones-generales-2019/
Disallow /elecciones/autonomicas-valencia-2019/
Disallow /elecciones/autonomicas-castilla-y-leon-2019/
Disallow /elecciones/historico/
Disallow /elecciones/elecciones-catalanas-2017/
Disallow /cartelera/
Disallow /peliculas-series/search?*
Disallow /peliculas-series/widgets/movies/
Disallow /topics/noticia/*
Disallow /topics/search?*
Disallow /andro4all/search/
Disallow /andro4all/via%3D
Disallow /andro4all/wp-json/
Disallow /andro4all/*...$
Disallow /andro4all/*/*/*/page/*
Disallow /andro4all/*wordfence_logHuman%3D1$
Disallow /andro4all/cdn-cgi/
Disallow /andro4all/*/%3Baspect-ratio
Disallow /andro4all/*/aspect-ratio
Disallow /andro4all/*/%7B%7B
Disallow /andro4all/mraid.js
Disallow /andro4all/*/undefined$
Disallow /search?*
Disallow /libros/search?*
Disallow /search-recipe?*
Disallow /comentarios/
Disallow /*/comentarios/
Disallow /*ID_PAGINA%3D1810072
Disallow /*ID_PAGINA%3D1810080
Disallow /*ID_PAGINA%3D200806163
Disallow /*ID_PAGINA%3D70172401
Disallow /*ID_PAGINA%3D82037585
Disallow /*ID_PAGINA%3D33872476
Disallow /*ID_PAGINA%3D70172401
Disallow /*ID_PAGINA%3D82037585
Disallow /*.swf$
Disallow /*.tif$
Disallow /*.mp3$
Disallow /*.flv$
Disallow /*.mp4$
Disallow /*.avi$
Disallow /*.txt$
Disallow /*.ics$

gptbot

Rule Path
Disallow /peliculas-series/

gptbot

Rule Path
Disallow /libros/

amazonbot

Rule Path
Disallow /peliculas-series/

amazonbot

Rule Path
Disallow /libros/

anthropic-ai

Rule Path
Disallow /peliculas-series/

anthropic-ai

Rule Path
Disallow /libros/

claude-web

Rule Path
Disallow /peliculas-series/

claude-web

Rule Path
Disallow /libros/

claudebot

Rule Path
Disallow /peliculas-series/

claudebot

Rule Path
Disallow /libros/

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mailto: techinfo@ubermetrics-technologies.com

Rule Path
Disallow /
Back to top

Comments

  • Temas
  • Paths a no indexar
  • Paths SEO a bloquear
  • Paginas LVD a no indexar
  • Extensiones de contenidos no indexables
  • Agentes nocivos conocidos
Back to top

Warnings

  • 2 invalid lines.
Back to top