elbierzonoticias.com
robots.txt

Robots Exclusion Standard data for elbierzonoticias.com

Resource Scan

Scan Details

Site Domain elbierzonoticias.com
Base Domain elbierzonoticias.com
Scan Status Ok
Last Scan2024-11-11T10:27:12+00:00
Next Scan 2024-11-18T10:27:12+00:00

Last Scan

Scanned2024-11-11T10:27:12+00:00
URL https://elbierzonoticias.com/robots.txt
Redirect https://www.elbierzonoticias.com/robots.txt
Redirect Domain www.elbierzonoticias.com
Redirect Base elbierzonoticias.com
Domain IPs 34.111.196.5
Redirect IPs 23.209.46.137, 23.209.46.149
Response IP 23.215.7.20
Found Yes
Hash fd75849735432fd2958a04e3b3a22405fceae02d9e7e74d9aab4e5aa16beb565
SimHash aa209370c131

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /acd/
Disallow /fcgi-bin/
Disallow /prensa/
Disallow */registro/
Disallow */popups
Disallow /*preview.html
Disallow /preview/
Disallow /_catalogo/
Disallow /includes/manuales/_catalogo/
Disallow /*?ns_
Disallow /zHomePrueba/index.html
Disallow /pruebaspubli.html
Allow /RC/*/Media/
Disallow /_cabeceraExterna/
Disallow /_config/
Disallow /externo/
Disallow /img/
Disallow /includes/
Disallow /metas.html
Disallow /_minicabecera/
Disallow /MM/
Disallow /modulos/
Disallow /nullmetas.html
Disallow /RC/
Disallow /SysConfig/
Disallow /4900/vocento.elbierzonoticias/
Disallow /hemeroteca/*.html?*
Disallow /module-amp/
Disallow */aggregate*
Disallow /backend/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elbierzonoticias.com/sitemap.xml
sitemap https://www.elbierzonoticias.com/sitemap.incremental.xml
sitemap https://www.elbierzonoticias.com/sitemap-video.xml

Comments

  • Robots www.elbierzonoticias.com
  • User Agents
  • redi16
  • Sitemaps