azulinehotels.com
robots.txt
Robots Exclusion Standard data for azulinehotels.com
Resource Scan
Scan Details
| Site Domain | azulinehotels.com |
| Base Domain | azulinehotels.com |
| Scan Status | Ok |
| Last Scan | 2024-10-17T22:36:55+00:00 |
| Next Scan | 2024-11-16T22:36:55+00:00 |
Last Scan
| Scanned | 2024-10-17T22:36:55+00:00 |
| URL | https://azulinehotels.com/robots.txt |
| Redirect | https://www.azulinehotels.com/robots.txt |
| Redirect Domain | www.azulinehotels.com |
| Redirect Base | azulinehotels.com |
| Domain IPs | 51.254.41.98 |
| Redirect IPs | 108.157.254.111, 108.157.254.115, 108.157.254.34, 108.157.254.97, 2600:9000:2753:1400:1a:687c:3300:93a1, 2600:9000:2753:2a00:1a:687c:3300:93a1, 2600:9000:2753:2c00:1a:687c:3300:93a1, 2600:9000:2753:5e00:1a:687c:3300:93a1, 2600:9000:2753:9400:1a:687c:3300:93a1, 2600:9000:2753:d400:1a:687c:3300:93a1, 2600:9000:2753:e800:1a:687c:3300:93a1, 2600:9000:2753:ec00:1a:687c:3300:93a1 |
| Response IP | 108.157.254.111 |
| Found | Yes |
| Hash | e7aa6a6b6b5f7800b25df2e671c25391d1241f99cc97c5aef64237597abd43f2 |
| SimHash | 54d2f087891b |
Groups
yandex*
yandex*
baidu*
yandex
nextgensearchbot
emailsiphon
emailwolf
extractorpro
cherrypicker
nicerspro
teleport
emailcollector
twiceler
psbot
ia_archiver
sosospider
voyager/2.0
cfetch/1.0
voyager-hc/1.0
speedy
yanga worldsearch bot v1.1/beta
yanga worldsearch bot v1.1/beta (http://www.yanga.co.uk/)
mj12bot
flatlandbot/baypup
flatlandbot
aisearchbot
woriobot
baiduspider
thunderstone
webinator
dotbot
mcbot
grub-client
hloader
home.thenewweb.com
httrack
ia_archiver
icollect
igetter
imagewalker
industry program
indy library
indy
internetlinkagent/
intscanner
installshield digitalwizard
installshield
ipd
innerprise
ipiumbot
iria
iupui research bot
java1.3.0
java1.3.1
java1
java2
java
jobo
joc web spider
johnhasbeenhere
kapere
lachesis
larbin
leechget
libwww-perl
lightningdownload
linkalarm
linkchecker
linklint-checkonly
linkman
llupdatectrl
mac finder
mail sweeper
mass downloader
mass
metaproducts download express
metaproducts
mfc_tear_sample
mfhttpscan
mygetright
naverbot
naverrobot
naver
netpumper
newt activex
newt
nicerspro
nitro downloader
nitro
nudelsalat
nutch
obot
offline explorer
offline
page_prefetcher
pagmiedownload
pavuk
plantynet_webrobot
plucker
pockey
popdexter
program shareware
program
progressive download
progressive
proxytester
puf
puxarapido
python-urllib
python-webchecker
robotmidareru
realdownload
rpt-httpclient
repomonkey bait & tackle
repomonkey
scat
scoutabout
sonic
semanticdiscovery
siphon
sitesnagger
sitewinder
slurp
slysearch
smartdownload
softwing_tear_agent
speeddownload
sprocket
sq webscanner
sq
stamina
star downloader
star
steeler
superhttp
surveybot
synobot
teleport
turnitinbot
tweakmaster
udmsearch
undisclosed
urlgetfile
utilmind httpget
utilmind
vcikjzddls
vobsub
webalta
webauto
webcapture
webclipping.com
webcollage
webcopier
webleacher
webmole
webreaper
websauger
website extractor
webstripper
webzip
wep search 00
wep search
whizbang
wildsoft surfer
wildsoft
winhttp.winhttprequest
www4mail
wwwoffle
xaldon webspider
xaldon
xedit
xenu
zao
zbot
zeus
zyborg
whsearch
yandex
moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /tools/ |
| Disallow | /pics/ |
Warnings
- 5 invalid lines.
Comments