Log In Sign Up

cdn.elheraldo.co
robots.txt

Robots Exclusion Standard data for cdn.elheraldo.co

Resource Scan

Scan Details

Site Domain cdn.elheraldo.co
Base Domain elheraldo.co
Scan Status Ok
Last Scan2024-05-26T21:28:16+00:00
Next Scan 2024-06-02T21:28:16+00:00

Last Scan

Scanned2024-05-26T21:28:16+00:00
URL https://cdn.elheraldo.co/robots.txt
Redirect https://www.elheraldo.co/robots.txt
Redirect Domain www.elheraldo.co
Redirect Base elheraldo.co
Domain IPs 169.48.223.138, 169.48.223.140, 169.48.223.141
Redirect IPs 169.48.223.138, 169.48.223.140, 169.48.223.141
Response IP 169.48.223.140
Found Yes
Hash 6411df8e71ae5047e7ce66deab36869dcddf4179da9962b90ae52b67afb83454
SimHash 2896d3cace71

Groups

*

Rule Path
Allow /misc/*.css$
Allow /misc/*.css?
Allow /misc/*.js$
Allow /misc/*.js?
Allow /misc/*.gif
Allow /misc/*.jpg
Allow /misc/*.jpeg
Allow /misc/*.png
Allow /modules/*.css$
Allow /modules/*.css?
Allow /modules/*.js$
Allow /modules/*.js?
Allow /modules/*.gif
Allow /modules/*.jpg
Allow /modules/*.jpeg
Allow /modules/*.png
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /themes/*.css$
Allow /themes/*.css?
Allow /themes/*.js$
Allow /themes/*.js?
Allow /themes/*.gif
Allow /themes/*.jpg
Allow /themes/*.jpeg
Allow /themes/*.png
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /dashboard-editorial
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /node/*
Disallow /encuesta/*
Disallow /user/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /usuario-autenticado/
Disallow /usuario-autenticado/*
Disallow /buscar-usuarios/
Disallow /resultados/
Disallow /resultados/*
Disallow /templates/
Disallow /templates/*
Disallow /brand/
Disallow /brand/*
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /scroll/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

cxensebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

newsproxy.app

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

netseer

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.elheraldo.co/gglnws.xml
sitemap https://www.elheraldo.co/stmps.xml
sitemap https://www.elheraldo.co/stmps-history-480001-485000.xml
sitemap https://www.elheraldo.co/stmps-history-475001-480000.xml
sitemap https://www.elheraldo.co/stmps-history-470001-475000.xml
sitemap https://www.elheraldo.co/stmps-history-465001-470000.xml
sitemap https://www.elheraldo.co/stmps-history-460001-465000.xml
sitemap https://www.elheraldo.co/stmps-history-460001-465000.xml
sitemap https://www.elheraldo.co/stmps-history-455001-460000.xml
sitemap https://www.elheraldo.co/stmps-history-450001-455000.xml
sitemap https://www.elheraldo.co/stmps-history-445001-450000.xml
sitemap https://www.elheraldo.co/stmps-history-440001-445000.xml
sitemap https://www.elheraldo.co/stmps-history-435001-440000.xml
sitemap https://www.elheraldo.co/stmps-history-430001-435000.xml
sitemap https://www.elheraldo.co/stmps-history-425001-430000.xml
sitemap https://www.elheraldo.co/stmps-history-420001-425000.xml
sitemap https://www.elheraldo.co/stmps-history-415001-420000.xml
sitemap https://www.elheraldo.co/stmps-history-410001-415000.xml
sitemap https://www.elheraldo.co/stmps-history-405001-410000.xml
sitemap https://www.elheraldo.co/stmps-history-400001-405000.xml
sitemap https://www.elheraldo.co/stmps-history-395001-400000.xml
sitemap https://www.elheraldo.co/stmps-history-390001-395000.xml
sitemap https://www.elheraldo.co/stmps-history-385001-390000.xml
sitemap https://www.elheraldo.co/stmps-history-380001-385000.xml
sitemap https://www.elheraldo.co/stmps-history-375001-380000.xml
sitemap https://www.elheraldo.co/stmps-history-370001-375000.xml
sitemap https://www.elheraldo.co/stmps-history-365001-370000.xml
sitemap https://www.elheraldo.co/stmps-history-360001-365000.xml
sitemap https://www.elheraldo.co/stmps-history-355001-360000.xml
sitemap https://www.elheraldo.co/stmps-history-350001-355000.xml
sitemap https://www.elheraldo.co/stmps-history-345001-350000.xml
sitemap https://www.elheraldo.co/stmps-history-340001-345000.xml
sitemap https://www.elheraldo.co/stmps-history-335001-340000.xml
sitemap https://www.elheraldo.co/stmps-history-330001-335000.xml
sitemap https://www.elheraldo.co/stmps-history-325001-330000.xml
sitemap https://www.elheraldo.co/stmps-history-320001-325000.xml
sitemap https://www.elheraldo.co/stmps-history-315001-320000.xml
sitemap https://www.elheraldo.co/stmps-history-310001-315000.xml
sitemap https://www.elheraldo.co/stmps-history-305001-310000.xml
sitemap https://www.elheraldo.co/stmps-history-300001-305000.xml
sitemap https://www.elheraldo.co/stmps-history-295001-300000.xml
sitemap https://www.elheraldo.co/stmps-history-290001-295000.xml
sitemap https://www.elheraldo.co/stmps-history-285001-290000.xml
sitemap https://www.elheraldo.co/stmps-history-280001-285000.xml
sitemap https://www.elheraldo.co/stmps-history-275001-280000.xml
sitemap https://www.elheraldo.co/stmps-history-270001-275000.xml
sitemap https://www.elheraldo.co/stmps-history-265001-270000.xml
sitemap https://www.elheraldo.co/stmps-history-260001-265000.xml
sitemap https://www.elheraldo.co/stmps-history-255001-260000.xml
sitemap https://www.elheraldo.co/stmps-history-250001-255000.xml
sitemap https://www.elheraldo.co/stmps-history-245001-250000.xml
sitemap https://www.elheraldo.co/stmps-history-240001-245000.xml
sitemap https://www.elheraldo.co/stmps-history-235001-240000.xml
sitemap https://www.elheraldo.co/stmps-history-230001-235000.xml
sitemap https://www.elheraldo.co/stmps-history-225001-230000.xml
sitemap https://www.elheraldo.co/stmps-history-220001-225000.xml
sitemap https://www.elheraldo.co/stmps-history-215001-220000.xml
sitemap https://www.elheraldo.co/stmps-history-210001-215000.xml
sitemap https://www.elheraldo.co/stmps-history-205001-210000.xml
sitemap https://www.elheraldo.co/stmps-history-200001-205000.xml
sitemap https://www.elheraldo.co/stmps-history-195001-200000.xml
sitemap https://www.elheraldo.co/stmps-history-190001-195000.xml
sitemap https://www.elheraldo.co/stmps-history-185001-190000.xml
sitemap https://www.elheraldo.co/stmps-history-180001-185000.xml
sitemap https://www.elheraldo.co/stmps-history-175001-180000.xml
sitemap https://www.elheraldo.co/stmps-history-170001-175000.xml
sitemap https://www.elheraldo.co/stmps-history-165001-170000.xml
sitemap https://www.elheraldo.co/stmps-history-160001-165000.xml
sitemap https://www.elheraldo.co/stmps-history-155001-160000.xml
sitemap https://www.elheraldo.co/stmps-history-150001-155000.xml
sitemap https://www.elheraldo.co/stmps-history-145001-150000.xml
sitemap https://www.elheraldo.co/stmps-history-140001-145000.xml
sitemap https://www.elheraldo.co/stmps-history-135001-140000.xml
sitemap https://www.elheraldo.co/stmps-history-130001-135000.xml
sitemap https://www.elheraldo.co/stmps-history-125001-130000.xml
sitemap https://www.elheraldo.co/stmps-history-120001-125000.xml
sitemap https://www.elheraldo.co/stmps-history-115001-120000.xml
sitemap https://www.elheraldo.co/stmps-history-110001-115000.xml
sitemap https://www.elheraldo.co/stmps-history-105001-110000.xml
sitemap https://www.elheraldo.co/stmps-history-100001-105000.xml
sitemap https://www.elheraldo.co/stmps-history-95001-100000.xml
sitemap https://www.elheraldo.co/stmps-history-90001-95000.xml
sitemap https://www.elheraldo.co/stmps-history-85001-90000.xml
sitemap https://www.elheraldo.co/stmps-history-80001-85000.xml
sitemap https://www.elheraldo.co/stmps-history-75001-80000.xml
sitemap https://www.elheraldo.co/stmps-history-70001-75000.xml
sitemap https://www.elheraldo.co/stmps-history-65001-70000.xml
sitemap https://www.elheraldo.co/stmps-history-60001-65000.xml
sitemap https://www.elheraldo.co/stmps-history-55001-60000.xml
sitemap https://www.elheraldo.co/stmps-history-50001-55000.xml
sitemap https://www.elheraldo.co/stmps-history-45001-50000.xml
sitemap https://www.elheraldo.co/stmps-history-40001-45000.xml
sitemap https://www.elheraldo.co/stmps-history-35001-40000.xml
sitemap https://www.elheraldo.co/stmps-history-30001-35000.xml
sitemap https://www.elheraldo.co/stmps-history-25001-30000.xml
sitemap https://www.elheraldo.co/stmps-history-20001-25000.xml
sitemap https://www.elheraldo.co/stmps-history-15001-20000.xml
sitemap https://www.elheraldo.co/stmps-history-10001-15000.xml
sitemap https://www.elheraldo.co/stmps-history-5001-10000.xml
sitemap https://www.elheraldo.co/stmps-history-1-5000.xml
sitemap https://www.elheraldo.co/sitemap.xml
Back to top

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Agents
  • Robots
  • IA
  • Agentes AI
  • sitemaps
Back to top