Log In Sign Up

corazon.pe
robots.txt

Robots Exclusion Standard data for corazon.pe

Resource Scan

Scan Details

Site Domain corazon.pe
Base Domain corazon.pe
Scan Status Ok
Last Scan2024-11-14T13:51:56+00:00
Next Scan 2024-11-21T13:51:56+00:00

Last Scan

Scanned2024-11-14T13:51:56+00:00
URL https://corazon.pe/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 151.101.129.91
Found Yes
Hash cfb6c2687142815405a5658d232b5023c29330cbbca54f0f21d3bb73cc06f913
SimHash c45a5b8bccf7

Groups

*
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile
petalbot

Rule Path
Allow
Allow /sitemap/
Allow /sitemap/*
Allow /sitemaps/*
Allow /rss/
Allow /rss/*

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://corazon.pe/sitemap/amor.xml
sitemap https://corazon.pe/sitemap/belleza-y-moda.xml
sitemap https://corazon.pe/sitemap/estilo-de-vida.xml
sitemap https://corazon.pe/sitemap/horoscopo.xml
sitemap https://corazon.pe/sitemap/famosas.xml
sitemap https://corazon.pe/sitemap/hombres.xml
sitemap https://corazon.pe/sitemap/noticias.xml
sitemap https://corazon.pe/rss
Back to top

Comments

  • Public Info
  • Sitemaps
  • Rss
  • Agentes nocivos conocidos
Back to top