tiempo.hn
robots.txt

Robots Exclusion Standard data for tiempo.hn

Resource Scan

Scan Details

Site Domain tiempo.hn
Base Domain tiempo.hn
Scan Status Ok
Last Scan2024-11-15T10:19:20+00:00
Next Scan 2024-11-22T10:19:20+00:00

Last Scan

Scanned2024-11-15T10:19:20+00:00
URL https://tiempo.hn/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 151.101.2.132
Found Yes
Hash 2f36a4e4816a0e95cd6e6a6b763c339fd36928ec170f0e110404c8f96a036c3c
SimHash e18055dc06b7

Groups

*

Rule Path
Allow /wp-content/uploads/*
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Allow /feed/$
Disallow /feed/
Disallow /tag/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/tag/$
Disallow /*/*/tag/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /recommended/
Disallow /comments/feed/
Disallow /wp-content/plugins/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /informe-federal-ee-uu-vinculan-promerica-lavado-dinero
Disallow /?server-status

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

datafeedwatch

Rule Path
Disallow /

gowikibot

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

simplecrawler

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

bnf.fr_bot

Rule Path
Disallow /

ninja bot

Rule Path
Disallow /

cutbot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

aaabot
accompanybot
adbot
adsrvrbot
adstxtcrawler
adstxtcrawlertp
alexionresearchbot
alittle client
antbot
anybot
aranhabot
aream
crawler
ateniumbot
autoemailspider
badbot
bananabot
bbot
bimbot
borneobot
bot
brands-bot
brands-bot-logo
browserclienta
bsbot
centro
ads.txt
crawler
centurybot9
cf-uc
user agent
chimebot
chimeunfurlagent
clark-crawler
clcrawler
crawlbot
crawlyprojectcrawler
dark_nexus_qbot
dautobot
davecrawler
df bot
dmbot
dnbcrawler
downloaderchrome
ds-robot
elisabot
fake bot
fake_bot
fast-webcrawler
flfbaldrbot
florkz.
friendly-spider
fuze_bot
globalgoalsdirectorybot
goodbot
googlerot
grover
gschaid bot
headless chrome
headless edge
hello world
implcit:adstxt-scrapr
info bot
isscyberriskcrawler
jaddjabot
jurgendata
kauaibot
kauaislowbot
keerthi bot
keys-so-bot
lanaibot
linabot
lolbot
loli_spider
lunabot magellan
mauibot
metadatascraper
mjbot
monibot
moonbot
my nutch spider
my-tiny-bot
mybot
nbertaupete95
newspaper
nicecrawler
niuebot
nutch
spider
nvdorz
ogscrper
orbbot
p40bot
phantombot
phxbot
pleskbot
polaris
botnet
polite-crawler
politecrawl
popscreen bot
privatebot
qbot
rainbot
rely bot
researchbot
researchxoftheweb
rssreaderbot
rw_crawler
scamadviserexternalhit
sc_bot
sebot-wa
sempi.tech bot
seolyt
seoscanners.net bot
snap url preview service
spider
stactbot
storm-crawler
superbot
tes-cocrawler
test certificate info
test-bot
testbot
thinkchaos
tinybottestua
tinytestbot
tinytestboty
tmm crawler
tpradstxtcrawler
trendsmapresolver
trokambot
unknown bot
viberbot
vsusearchspider
web crawler
web-crawler
webbot
webcrawler
websusebot
whatstuffwherebot
wirereaderbot
wordup-1
wordupindexinfo1
xtc
botnet
yff35
yunsecuritybot
zephuli-bot _1z_bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tiempo.hn/sitemap_index.xml

Warnings

  • 3 invalid lines.