tiempo.hn
robots.txt
Robots Exclusion Standard data for tiempo.hn
Resource Scan
Scan Details
Site Domain | tiempo.hn |
Base Domain | tiempo.hn |
Scan Status | Ok |
Last Scan | 2024-11-15T10:19:20+00:00 |
Next Scan | 2024-11-22T10:19:20+00:00 |
Last Scan
Scanned | 2024-11-15T10:19:20+00:00 |
URL | https://tiempo.hn/robots.txt |
Domain IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
Response IP | 151.101.2.132 |
Found | Yes |
Hash | 2f36a4e4816a0e95cd6e6a6b763c339fd36928ec170f0e110404c8f96a036c3c |
SimHash | e18055dc06b7 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/* |
Allow | /wp-content/*.js |
Allow | /wp-content/*.css |
Allow | /wp-includes/*.js |
Allow | /wp-includes/*.css |
Allow | /feed/$ |
Disallow | /feed/ |
Disallow | /tag/ |
Disallow | /comments/feed/ |
Disallow | /*/feed/$ |
Disallow | /*/feed/rss/$ |
Disallow | /*/trackback/$ |
Disallow | /*/tag/$ |
Disallow | /*/*/tag/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/trackback/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/trackback/$ |
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /wp-content/themes/ |
Disallow | /wp-includes/ |
Disallow | /recommended/ |
Disallow | /comments/feed/ |
Disallow | /wp-content/plugins/ |
Disallow | /trackback/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
Disallow | /informe-federal-ee-uu-vinculan-promerica-lavado-dinero |
Disallow | /?server-status |
aaabot
accompanybot
adbot
adsrvrbot
adstxtcrawler
adstxtcrawlertp
alexionresearchbot
alittle client
antbot
anybot
aranhabot
aream
crawler
ateniumbot
autoemailspider
badbot
bananabot
bbot
bimbot
borneobot
bot
brands-bot
brands-bot-logo
browserclienta
bsbot
centro
ads.txt
crawler
centurybot9
cf-uc
user agent
chimebot
chimeunfurlagent
clark-crawler
clcrawler
crawlbot
crawlyprojectcrawler
dark_nexus_qbot
dautobot
davecrawler
df bot
dmbot
dnbcrawler
downloaderchrome
ds-robot
elisabot
fake bot
fake_bot
fast-webcrawler
flfbaldrbot
florkz.
friendly-spider
fuze_bot
globalgoalsdirectorybot
goodbot
googlerot
grover
gschaid bot
headless chrome
headless edge
hello world
implcit:adstxt-scrapr
info bot
isscyberriskcrawler
jaddjabot
jurgendata
kauaibot
kauaislowbot
keerthi bot
keys-so-bot
lanaibot
linabot
lolbot
loli_spider
lunabot magellan
mauibot
metadatascraper
mjbot
monibot
moonbot
my nutch spider
my-tiny-bot
mybot
nbertaupete95
newspaper
nicecrawler
niuebot
nutch
spider
nvdorz
ogscrper
orbbot
p40bot
phantombot
phxbot
pleskbot
polaris
botnet
polite-crawler
politecrawl
popscreen bot
privatebot
qbot
rainbot
rely bot
researchbot
researchxoftheweb
rssreaderbot
rw_crawler
scamadviserexternalhit
sc_bot
sebot-wa
sempi.tech bot
seolyt
seoscanners.net bot
snap url preview service
spider
stactbot
storm-crawler
superbot
tes-cocrawler
test certificate info
test-bot
testbot
thinkchaos
tinybottestua
tinytestbot
tinytestboty
tmm crawler
tpradstxtcrawler
trendsmapresolver
trokambot
unknown bot
viberbot
vsusearchspider
web crawler
web-crawler
webbot
webcrawler
websusebot
whatstuffwherebot
wirereaderbot
wordup-1
wordupindexinfo1
xtc
botnet
yff35
yunsecuritybot
zephuli-bot _1z_bot
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://tiempo.hn/sitemap_index.xml |
Warnings
- 3 invalid lines.