leonoticias.com
robots.txt

Robots Exclusion Standard data for leonoticias.com

Resource Scan

Scan Details

Site Domain leonoticias.com
Base Domain leonoticias.com
Scan Status Ok
Last Scan2024-11-14T19:05:42+00:00
Next Scan 2024-11-21T19:05:42+00:00

Last Scan

Scanned2024-11-14T19:05:42+00:00
URL https://leonoticias.com/robots.txt
Redirect https://www.leonoticias.com/robots.txt
Redirect Domain www.leonoticias.com
Redirect Base leonoticias.com
Domain IPs 23.209.46.159, 23.209.46.162
Redirect IPs 23.209.46.159, 23.209.46.162
Response IP 96.17.180.50
Found Yes
Hash a090f0768234a649154fe0d532c7399049014bc41e2cd302d50a1827b6d10260
SimHash ac2193700ab1

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

twitterbot

Rule Path
Disallow *

*

Rule Path
Disallow /acd/
Disallow /fcgi-bin/
Disallow /prensa/
Disallow */registro/
Disallow */popups
Disallow /*preview.html
Disallow /preview/
Disallow /_catalogo/
Disallow /includes/manuales/_catalogo/
Disallow /*?ns_
Disallow /zHomePrueba/index.html
Disallow /pruebaspubli.html
Allow /eltiempo/castilla-y-leon/leon/
Disallow /_cabeceraExterna/
Disallow /_config/
Disallow /externo/
Disallow /includes/
Disallow /metas.html
Disallow /_minicabecera/
Disallow /MM/
Disallow /modulos/
Disallow /nullmetas.html
Disallow /RC/
Disallow /SysConfig/
Disallow /4900/vocento.leonoticias/
Disallow /leonoticias/MM/
Disallow /leonoticias/noticias/
Disallow /apoyos/documentos/
Disallow /gl-d/
Disallow */gl-d$
Disallow /ht-d/
Disallow */ht-d$
Disallow /bb-d/
Disallow */bb-d$
Disallow /module-amp/
Disallow */aggregate*
Disallow /backend/
Disallow /hemeroteca/*.html
Disallow /feed/
Disallow /feeds/
Disallow /campo/
Disallow */frontend/*

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.leonoticias.com/sitemap.xml
sitemap https://www.leonoticias.com/sitemap.incremental.xml
sitemap https://www.leonoticias.com/sitemap-video.xml
sitemap https://www.leonoticias.com/sitemap-temas.xml

Comments

  • User Agents
  • redi16
  • mobile
  • Sitemaps