Log In Sign Up

larepublica.pe
robots.txt

Robots Exclusion Standard data for larepublica.pe

Resource Scan

Scan Details

Site Domain larepublica.pe
Base Domain larepublica.pe
Scan Status Ok
Last Scan2024-06-22T23:43:12+00:00
Next Scan 2024-06-29T23:43:12+00:00

Last Scan

Scanned2024-06-22T23:43:12+00:00
URL https://larepublica.pe/robots.txt
Domain IPs 13.33.88.124, 13.33.88.24, 13.33.88.33, 13.33.88.40
Response IP 13.33.88.124
Found Yes
Hash c76874d46f68d2d085d70986606a15cbe6c90fff704e13810e0177777703daf1
SimHash 047b42cb4ae2

Groups

*
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile

Rule Path
Disallow /buscador*
Disallow /data
Disallow /data/*
Disallow /contactenos
Disallow /*/pag/
Disallow /*/pag/*
Disallow /*/*/page/*
Disallow /archive/*
Disallow /archivo/*
Disallow /node/*
Disallow /taxonomy/term/*
Disallow /assets/*
Disallow /files/*
Disallow /comment/reply/*
Disallow /envivo/*
Disallow /*/tag/*
Disallow */*Per%C3%BA
Disallow */Encuesta*
Disallow */EMPRESA/*
Disallow *ref%3Dphotogallery*
Disallow */sitemaps/*
Disallow */pf/*
Allow /sitemap/
Allow /sitemap/*
Allow /sitemaps/*
Allow /rss/
Allow /rss/*

petalbot
ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://larepublica.pe/sitemap/noticias.xml
sitemap https://larepublica.pe/sitemap/loterias-sorteos.xml
sitemap https://larepublica.pe/sitemap/datos-lr.xml
sitemap https://larepublica.pe/sitemap/deportes.xml
sitemap https://larepublica.pe/sitemap/politica.xml
sitemap https://larepublica.pe/sitemap/sociedad.xml
sitemap https://larepublica.pe/sitemap/cultura-asiatica.xml
sitemap https://larepublica.pe/sitemap/cine-series.xml
sitemap https://larepublica.pe/sitemap/economia.xml
sitemap https://larepublica.pe/sitemap/espectaculos.xml
sitemap https://larepublica.pe/sitemap/mundo.xml
sitemap https://larepublica.pe/sitemap/tendencias.xml
sitemap https://larepublica.pe/sitemap/animes.xml
sitemap https://larepublica.pe/sitemap/ciencia.xml
sitemap https://larepublica.pe/sitemap/tecnologia.xml
sitemap https://larepublica.pe/sitemap/horoscopo.xml
sitemap https://larepublica.pe/sitemap/sexualidad.xml
sitemap https://larepublica.pe/sitemap/verificador.xml
sitemap https://larepublica.pe/sitemap/turismo.xml
sitemap https://larepublica.pe/sitemap/salud.xml
sitemap https://larepublica.pe/sitemap/autos.xml
sitemap https://larepublica.pe/sitemap/gastronomia.xml
sitemap https://larepublica.pe/sitemap/videojuegos.xml
sitemap https://larepublica.pe/sitemap/estados-unidos.xml
sitemap https://larepublica.pe/rss/loterias-sorteos.xml
sitemap https://larepublica.pe/rss/datos-lr.xml
sitemap https://larepublica.pe/rss/deportes.xml
sitemap https://larepublica.pe/rss/politica.xml
sitemap https://larepublica.pe/rss/sociedad.xml
sitemap https://larepublica.pe/rss/cultura-asiatica.xml
sitemap https://larepublica.pe/rss/cine-series.xml
sitemap https://larepublica.pe/rss/economia.xml
sitemap https://larepublica.pe/rss/espectaculos.xml
sitemap https://larepublica.pe/rss/mundo.xml
sitemap https://larepublica.pe/rss/tendencias.xml
sitemap https://larepublica.pe/rss/animes.xml
sitemap https://larepublica.pe/rss/ciencia.xml
sitemap https://larepublica.pe/rss/tecnologia.xml
sitemap https://larepublica.pe/rss/horoscopo.xml
sitemap https://larepublica.pe/rss/sexualidad.xml
sitemap https://larepublica.pe/rss/verificador.xml
sitemap https://larepublica.pe/rss/turismo.xml
sitemap https://larepublica.pe/rss/salud.xml
sitemap https://larepublica.pe/rss/autos.xml
sitemap https://larepublica.pe/rss/gastronomia.xml
sitemap https://larepublica.pe/rss/videojuegos.xml
sitemap https://larepublica.pe/rss/estados-unidos.xml
sitemap https://lol.larepublica.pe/sitemap/noticias.xml
Back to top

Comments

  • Info private
  • recomendaciones disallow nomadic
  • Info publica
  • Sitemaps
  • RSS
  • Sitemap de lol
  • 26/07/2022
  • 15 set 2022 LOL
  • 10/11/2022
  • 16/02/2023 actualización del sitemap
  • 14/03/2023 recomendacion nomadic
  • 27/10/2023 Nuevos sitemaps
  • 16may2024 inherit live
  • 21/05/2024 inherit and disallow bot
  • la mayoria de veces causa problemas
Back to top