larioja.com
robots.txt

Robots Exclusion Standard data for larioja.com

Resource Scan

Scan Details

Site Domain larioja.com
Base Domain larioja.com
Scan Status Ok
Last Scan2024-06-23T17:29:44+00:00
Next Scan 2024-06-30T17:29:44+00:00

Last Scan

Scanned2024-06-23T17:29:44+00:00
URL https://larioja.com/robots.txt
Redirect https://www.larioja.com/robots.txt
Redirect Domain www.larioja.com
Redirect Base larioja.com
Domain IPs 23.52.171.226, 23.59.168.184
Redirect IPs 23.52.171.226, 23.59.168.184
Response IP 23.52.171.226
Found Yes
Hash 5075dc7f56791507fd673a37af85d5abb0d0080d673cfaffbd98ead88abc85ee
SimHash a825935453f1

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

twitterbot

Rule Path
Disallow *

*

Rule Path
Disallow /acd/
Allow /RC/*/media/
Disallow /fcgi-bin/
Disallow */prensa/
Disallow */interactivo/comun/contactar.html
Disallow */interactivo/comun/condiciones.html
Disallow */interactivo/comun/privacidad.html
Disallow */interactivo/comun/publicidad.html
Disallow */registro/
Disallow */popups
Disallow /*preview.html
Disallow /preview/
Disallow /_catalogo/
Disallow /*?ns_
Allow /eltiempo/la-rioja/
Disallow /_cabeceraExterna/
Disallow /_config/
Disallow /includes/
Disallow /menu-simple/
Disallow /MM/
Disallow /modulos/
Disallow /RC/
Disallow /MSN/
Disallow /SysConfig/
Disallow /4900/webm.LARIOJA/
Disallow /4900/vocento.larioja/
Disallow /zHomePrueba/index.html
Disallow /pruebaspubli.html
Disallow /la_rioja/MM/
Disallow /la_rioja/noticias/
Disallow /apoyos/documentos/
Disallow /gl-d/
Disallow */gl-d$
Disallow /ht-d/
Disallow */ht-d$
Disallow /bb-d/
Disallow */bb-d$
Disallow /eltiempo/
Disallow /module-amp/
Disallow */aggregate*
Disallow /backend/
Disallow */multimedia/fotos/
Disallow */pg*/prensa/
Disallow */planes/2014
Disallow */planes/2016
Disallow /hemeroteca/*.html

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.larioja.com/sitemap.xml
sitemap https://www.larioja.com/sitemap.incremental.xml
sitemap https://www.larioja.com/sitemap-video.xml
sitemap https://www.larioja.com/sitemap-temas.xml

Comments

  • User Agents
  • redi14
  • ads
  • mob
  • temp
  • Sitemaps