iconoedu.com
robots.txt

Robots Exclusion Standard data for iconoedu.com

Resource Scan

Scan Details

Site Domain iconoedu.com
Base Domain iconoedu.com
Scan Status Ok
Last Scan2024-10-25T10:50:09+00:00
Next Scan 2024-11-24T10:50:09+00:00

Last Scan

Scanned2024-10-25T10:50:09+00:00
URL https://iconoedu.com/robots.txt
Redirect https://www.iconoedu.com/robots.txt
Redirect Domain www.iconoedu.com
Redirect Base iconoedu.com
Domain IPs 88.99.136.126
Redirect IPs 88.99.136.126
Response IP 88.99.136.126
Found Yes
Hash f90174030f1be5a92185b4c2fbdef206e2932a5dbb4075aa6032f82a792c15cd
SimHash 4453d8868d1b

Groups

yandex*
yandex*
baidu*
yandex
nextgensearchbot
emailsiphon
emailwolf
extractorpro
cherrypicker
nicerspro
teleport
emailcollector
twiceler
psbot
ia_archiver
sosospider
voyager/2.0
cfetch/1.0
voyager-hc/1.0
speedy
yanga worldsearch bot v1.1/beta
yanga worldsearch bot v1.1/beta (http://www.yanga.co.uk/)
mj12bot
flatlandbot/baypup
flatlandbot
aisearchbot
woriobot
baiduspider
thunderstone
webinator
dotbot
mcbot
grub-client
hloader
home.thenewweb.com
httrack
icollect
igetter
imagewalker
industry program
indy library
indy
internetlinkagent/
intscanner
installshield digitalwizard
installshield
ipd
innerprise
ipiumbot
iria
iupui research bot
java1.3.0
java1.3.1
java1
java2
java
jobo
joc web spider
johnhasbeenhere
kapere
lachesis
larbin
leechget
libwww-perl
lightningdownload
linkalarm
linkchecker
linklint-checkonly
linkman
llupdatectrl
mac finder
mail sweeper
mass downloader
mass
metaproducts download express
metaproducts
mfc_tear_sample
mfhttpscan
mygetright
naverbot
naverrobot
naver
net probe
netpumper
newt activex
newt
nitro downloader
nitro
nudelsalat
nutch
obot
offline explorer
offline
page_prefetcher
pagmiedownload
pavuk
plantynet_webrobot
plucker
pockey
popdexter
program shareware
program
progressive download
progressive
proxytester
puf
puxarapido
python-urllib
python-webchecker
robotmidareru
realdownload
rpt-httpclient
repomonkey bait & tackle
repomonkey
scat
scoutabout
sonic
semanticdiscovery
siphon
sitesnagger
sitewinder
slurp
slysearch
smartdownload
softwing_tear_agent
speeddownload
sprocket
sq webscanner
sq
ssm agent
stamina
star downloader
star
steeler
superhttp
surveybot
synobot
tom bot
tsw bot
turnitinbot
tweakmaster
udmsearch
undisclosed
urlgetfile
utilmind httpget
utilmind
vcikjzddls
vobsub
webalta
webauto
webcapture
webclipping.com
webcollage
webcopier
web downloader
webleacher
webmole
webreaper
websauger
website extractor
webstripper
webzip
wep search 00
wep search
whizbang
wildsoft surfer
wildsoft
winhttp.winhttprequest
www4mail
wwwoffle
xaldon webspider
xaldon
xedit
xenu
zao
zbot
zeus
zyborg
whsearch
moget
ichiro
yeti
baiduspider-video
baiduspider-image
sogou spider
youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /bikube/
Disallow /static/bikube/

Other Records

Field Value
sitemap https://www.iconoedu.com/sitemap.ca.xml
sitemap https://www.iconoedu.com/sitemap.en.xml
sitemap https://www.iconoedu.com/sitemap.es.xml

Comments

  • Sorry guys, you aren't welcome!
  • Hi Google, Yahoo, do you want a beer? DonĀ“t waste your time scraping following URLs
  • Nice sitemaps :-)