comercio.com.pe
robots.txt

Robots Exclusion Standard data for comercio.com.pe

Resource Scan

Scan Details

Site Domain comercio.com.pe
Base Domain comercio.com.pe
Scan Status Ok
Last Scan2024-10-20T04:01:40+00:00
Next Scan 2024-11-19T04:01:40+00:00

Last Scan

Scanned2024-10-20T04:01:40+00:00
URL http://www.comercio.com.pe/robots.txt
Redirect https://elcomercio.pe/robots.txt
Redirect Domain elcomercio.pe
Redirect Base elcomercio.pe
Domain IPs 50.19.94.67
Redirect IPs 2600:1413:5000:3::1736:768d, 2600:1413:5000:3::1736:76a8, 42.99.140.177, 42.99.140.217
Response IP 42.99.140.217
Found Yes
Hash 19a950757d5be7b0a111ad3c5e9ca28e21a6c103853bf0ba76cdbc641b66da32
SimHash b1fa67dacd27

Groups

*

Rule Path
Disallow /catalogo/
Disallow /archivo/todas/19*
Disallow /archivo/todas/200*
Disallow /respuestas/quien/buscados-pnp-peru-2018-policia-nacional-peru-interpol-asesinos-trafico-drogas-influencias-nnda-nnlt-noticia-564210-noticia/

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://elcomercio.pe/sitemap/?outputType=xml
sitemap https://elcomercio.pe/sitemap/politica/?outputType=xml
sitemap https://elcomercio.pe/sitemap/peru/?outputType=xml
sitemap https://elcomercio.pe/sitemap/lima/?outputType=xml
sitemap https://elcomercio.pe/sitemap/tecnologia/?outputType=xml
sitemap https://elcomercio.pe/sitemap/mundo/?outputType=xml
sitemap https://elcomercio.pe/sitemap/economia/?outputType=xml
sitemap https://elcomercio.pe/sitemap/luces/?outputType=xml
sitemap https://elcomercio.pe/sitemap/tvmas/?outputType=xml
sitemap https://elcomercio.pe/sitemap/deporte-total/?outputType=xml
sitemap https://elcomercio.pe/sitemap/gastronomia/?outputType=xml
sitemap https://elcomercio.pe/sitemap/opinion/?outputType=xml
sitemap https://elcomercio.pe/sitemap/colecciones-el-comercio/?outputType=xml
sitemap https://elcomercio.pe/sitemap/wuf/?outputType=xml
sitemap https://elcomercio.pe/sitemap/videos/?outputType=xml
sitemap https://elcomercio.pe/sitemap/viu/?outputType=xml
sitemap https://elcomercio.pe/sitemap/vamos/?outputType=xml
sitemap https://elcomercio.pe/sitemap/ruedas-tuercas/?outputType=xml
sitemap https://elcomercio.pe/sitemap/casa-y-mas/?outputType=xml
sitemap https://elcomercio.pe/sitemap/eldominical/?outputType=xml
sitemap https://elcomercio.pe/sitemap/publirreportaje/?outputType=xml
sitemap https://elcomercio.pe/sitemap/archivo-elcomercio/?outputType=xml
sitemap https://elcomercio.pe/sitemap/respuestas/?outputType=xml
sitemap https://elcomercio.pe/sitemap/somos/?outputType=xml
sitemap https://elcomercio.pe/sitemap/lifweek/?outputType=xml
sitemap https://elcomercio.pe/sitemap/mag/?outputType=xml
sitemap https://elcomercio.pe/arcio/google-news-feed/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/deporte-total/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/economia/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/gastronomia/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/insolito/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/lima/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/luces/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/mundo/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/opinion/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/peru/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/politica/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/redes-sociales/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/somos/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/tecnologia/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/tecnologia/e-sports/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/tvmas/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/vamos/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/viu/
sitemap https://elcomercio.pe/arcio/google-news-feed/category/mag/

Comments

  • la mayoria de veces causa problemas