iblbanca.it
robots.txt

Robots Exclusion Standard data for iblbanca.it

Resource Scan

Scan Details

Site Domain iblbanca.it
Base Domain iblbanca.it
Scan Status Ok
Last Scan2024-06-22T16:34:05+00:00
Next Scan 2024-07-22T16:34:05+00:00

Last Scan

Scanned2024-06-22T16:34:05+00:00
URL https://iblbanca.it/robots.txt
Domain IPs 20.105.224.15
Response IP 20.105.224.15
Found Yes
Hash efad701a72bc450b9919c8da5b87c46af52e2ffca7bacfcab3b2b9b684603fee
SimHash 634572334a86

Groups

*

Rule Path
Disallow /lp/
Disallow /funnel-mutui
Disallow /privacy.html
Disallow /funnel-cessione
Disallow /funnel-prestiti
Disallow /landing-prefiltro
Disallow /privacy_cookie.html
Disallow /funnel-assicurazioni

a1 sitemap generator
abachobot
abcdatos botlink
abonti
aboundex
aboundexbot
aboutusbot
accoona-ai-agent
acunetix
addsugarspiderbot
adidxbot
admantx
afd-verbotsverfahren
ahoy! the homepage finder
ahrefsbot
aibot
aihitbot
aipbot
aitcsrobot/1.1
alexibot
alligator
allsubmitter
alphabot
amznkassocbot
anarchie
apexoo
aqua_products
arachnophilia
architextspider
archive.org_bot
aspider/0.09
aspseek
asterias
attach
auresys/1.0
autoemailspider
awariorssbot
awariosmartbot
b2w/0.1
backdoorbot
backdoorbot/1.0
backlink-ceck
backlink-check
backlinkcrawler
backrub/.
backstreet
backweb
badass
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
bandit
barkrowler
batchftp
battleztar bazinga
bbbike
bdcbot
bdfetch
becomebot
beslistbot
betabot
big brother
bigfoot
bitacle
bizbot003
black hole
blackboard
blackwidow
blexbot
blow
blowfish
blowfish/1.0
boardreader
bolt
bookmark search tool
botalot
botrighthere
brandprotect
brandwatch
buddy
builtbottough
builtwith
bullseye
bullseye/1.0
bunnyslippers
buzzsumo
cactvs chemistry spider
calculon
catchbot
catexplorador
cazoodlebot
ccbot
cegbfeieh
checkbot/x.xx lwp/5.x
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
cheteam
chinaclaw
chlooe
claritybot
cliqzbot
cloud mapping
coccoc
coccocbot-web
cogentbot
cognitiveseo
collector
com.plumanalytics
combine/0.0
conceptbot/0.3
copernic
copier
copyrightcheck
copyscape
cosmos
craftbot
crawl.sogou.com
crawler.feedback
crawler4j
crazywebcrawler
crescent
crescent internet toolpak http ole control v.1.0
crunchbot
cshttp
curious
custo
cyberpatrol sitecat webbot
cyberspyder/2.1
databasedrivermysqli
datacha0s
daumoa
dblbot
demandbase-bot
demon
deusu
devil
deweb/1.01
digincore
digitalpebble
diibot
dirbuster
disco
disco pump 3.0
disco pump 3.2
discobot
discofinder
discoverybot
dispatch
dittospyder
dnyzbot
domainappender
domaincrawler
domainsigmacrawler
domainstatsbot
dotbot
download demon
download demon/3.2.0.8
download demon/3.5.0.11
download wonder
dragonfly
drip
dsearch
dts agent
dumbot
easydl
ebingbong
ecatch
ecatch/3.0
eccp/1.0
ecxi
eirgrabber
email siphon
email wolf
emailcollector
emailsiphon
emailwolf
enigmabot
envolk
erocrawler
evc-batch
evil
exabot
explorersearch
express webpictures
extlinksbot
extractor
extractorpro
extreme picture finder
eyenetie
ezooms
facebookscraper
fairad client
fdm
fdse robot
felixide/1.0
femtosearchbot
fhscan
fido/0.9 harvest/1.4.pl2
fimap
firefox/7.0
fish-search-robot
flaming attackbot
flashget
flashget webwasher 3.2
flunky
foobot
freecrawl
freeuploader
frontpage
fyberspider
fyrebot
gaisbot
galaxybot
genieo
germcrawler
getintent
getright
getright/4.2
getweb
getweb!
gigablast
gigabot
g-i-g-a-b-o-t
girafabot
go!zilla
go-ahead-got-it
golem/1.1
gotit
gozilla
grabber
grabnet
grafula
grapefx
grapeshot
grapeshotcrawler
gridbot
gromit/1.0
grub
grub-client
gsa-crawler
gt::www
haansoft
haosouspider
happyfunbot
harvest
harvest/1.5
hatena antenna
havij
hazel's ferret web hopper
headmasterseo
heritrix
hloader
hmview
htmlparser
http::lite
httplib
httrack
huaweisymantecspider
humanlinks
hybridbot
ia_archiver
iblog
idbot
id-search
ilsebot
image fetch
image stripper
image sucker
inagist.com url crawler
incywincy/1.0b1
indeedbot
indy library
infonavirobot
informant
infotekies
ingrid/0.1
instabid
intelliseek
interget
internet ninja
internet ninja 6.0
internetseer
internetvista monitor
ips-agent
iria
irlbot
iron33/1.0.2
iskanie
israelisearch/1.0
istellabot
iti spider
jamesbot
jbrofuzz
jennybot
jetcar
jetty
jikespider
joc web spider
joomla
jorgee
jubiirobot
jumpstation
justview
jyxobot
katipo/1.0
kenjin spider
keyword density
keyword density/0.9
kozmosbot
labelgrab/1.1
lanshanbot
larbin
leechftp
leechget
lexibot
lftp
libweb
libweb/clshttp
libwhisker
lightspeedsystems
likse
linguee bot
linkdexbot
linkdexbot/2.1
linkedinbot
linkextractorpro
linklooker
linkpadbot
linkscan
linkscan/8.1a unix
linksmanager
linkwalker
linqiametadatadownloaderbot
linqiarssbot
linqiascrapebot
lipperhey
lipperhey spider
litemage_walker
lmspider
lnspiderguy
looksmart
ltx71
lwp::simple
lwp-request
lwp-trivial
lwp-trivial/1.34
magnet
mag-net
magpie-crawler
mail.ru_bot
majestic seo
majestic12
majestic-seo
markmonitor
markwatch
mass downloader
mass downloader/2.2
masscan
mata hari
mauibot
meanpath bot
meanpathbot
mediafox/x.y
mediatoolkitbot
mediawords
megaindex.ru
merzscope
metagopher
metauri
mfc_tear_sample
microsoft data access
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
midown tool
miixpc
miixpc/4.2
mister pix
mj12bot
mnogosearch
moget
moget/2.1
mojeek
momspider/1.00 libwww-perl/0.40
morfeus fucking scanner
motor/0.2
mozilla/4.0 (compatible; bullseye; windows 95)
mr.4x3
ms web services client protocol
msfrontpage
msiecrawler
msrabot
msrbot
msr-isrccrawler
muhstik-scan
musobot
name intelligence
nameprotect
naver
naverbot
navroad
nearsite
needle
neosciocrawler
nessus
net vampire
net vampire/3.0
netants
netcarta cyberpilot pro
netcraft
netestate ne crawler
netlyzer
netmechanic
netscoop/1.0 libwww/5.0a
netspider
nettrack
netvibes
netzip
nextgensearchbot
nhsewalker/3.0
nibbler
nicerspro
niki-bot
nikto
nimblecrawler
nimbostratus
ninja
nmap
nomad-v2.x
northstar
npbot
nutch
obot
occam/1.0
octopus
offline explorer
offline navigator
ogspider
oncrawl
open text site crawler v1.0
openbot
openfind
openfind data gathere
openlinkprofiler
openvas
oracle ultra search
orangebot
orangespider
outclicksbot
outfoxbot
page analyzer
page scorer
pageanalyzer
pagegrabber
pagepeeker
pagescorer
pandalytics
panscient
papa foto
pavuk
pcbrowser
pecl::http
peoplepal
perman
pgp-ka/1.2
phpcrawl
picscout
picsearch
picturefinder
pimonster
pi-monster
pixray
pleasecrawl
plumanalytics
pockey
poe-component-client-http
probethenet
propowerbot
propowerbot/2.14
prowebwalker
psbot
pump
pxbroker
pycurl
python-urllib
queryn metasearch
quick-crawler
r6_commentreader
r6_feedfetcher
radiation retriever 1.1
rankactive
rankactivelinkbot
rankflex
rankingbot
rankingbot2
rankivabot
rankurbot
realdownload
realdownload/4.0.0.42
reaper
rebelmouse
recorder
redesscrapy
reget
repomonkey
repomonkey bait & tackle/v1.01
resume robot
ripper
rma
rocketcrawler
rogerbot
roverbot
s1z.ru
safetynet robot 0.1
salesintelligent
sbider
scan.lol
scanalert
scanbot
scoutjet
scrapy
screaming
screenerbot
searchestate
searchmetricsbot
searchpreview
semrush
semrushbot
senrigan/xxxxxx
seokicks
seokicks-robot
seolyticscrawler
seomoz
seoprofiler
seoscanners
seositecheckup
seostats
serpstatbot
sexsearcher
seznambot
shodan
siphon
sistrix
site sucker
sitebeam
siteexplorer
siteimprove
sitelockspider
sitesnagger
sitesucker
sitevigil
slysearch
smartdownload
smtbot
snake
snapbot
snooper/b97_01
snoopy
socialrankiobot
sociscraper
sogou web spider
sogouspider
solbot/1.0 lwp/5.07
sootle
sosospider
sottopop
sp_auditbot
spacebison
spammen
spankbot
spanner
spanner/1.0 (linux 2.0.27 i586)
spbot
speedy spider
spinn3r
sputnikbot
spyder3.microsys.com
spyfu
sqlmap
sqlworm
sqworm
steeler
stripper
sucker
sucuri
superbot
superhttp
superhttp/1.0
surfbot
surveybot
suzuran
swiftbot
sysscan
szukacz
szukacz/1.4
t0phackteam
t8abot
takeout
teleport
teleportpro
telesoft
telesphoreo
telesphorep
the intraformant
thenomad
thumbor
tighttwatbot
titan
toata
tocrawl/urldispatcher
toweyabot
tracemyfile
trendiction
trendiction.com
trendiction.de
trendictionbot
true_robot
true_robot/1.0
turingos
turnitin
turnitinbot
twengabot
twice
twiceler
typhoeus
ucsd-crawler
unisterbot
unwindfetchor/1.0
upflow
url control
url_spider_pro
urlck/1.2.3
urly warning
urly.warning
vacuum
vagabondo
valkyrie/1.0 libwww-perl/0.40
vb project
vbseo
vci
vci webviewer vci webviewer win32
vericitecrawler
vidiblescraper
virusdie
voideye
voil
voilabot
voltron
wallpapers/3.0
wallpapershd
wasalive-bot
wbsearchbot
web auto
web collage
web enhancer
web fetch
web fuck
web image collector
web pix
web sauger
web sucker
webalta
webauto
webbandit
webbandit/3.50
webcollage
webcopier
webdav
webenhancer
webferret
webfetch
webfuck
webgo is
webimagecollector
webleacher
webmasterworld extractor
webmasterworldforumbot
webmeup-crawler
webpix
webreaper
websauger
webshag
website quester
websiteextractor
websitequester
webster
webster pro
webstripper
websucker
webvac
webwalk
webwatch
webwhacker
webzip
webzip/4.0
wesee
wget
wget/1.5.3
wget/1.6
whack
whacker
whatweb
who.is bot
whowhere robot
widow
winhttrack
wiseguys robot
wisenutbot
wonderbot
woobot
wotbox
wprecon
wpscan
www::mechanize
www-collector-e
www-mechanize
wwwoffle
x09mozilla
x22mozilla
xaldon webspider
xaldon_webspider
xenu
xpymep1.exe
yandex
youdaobot
zade
zauba
zauba.io
zermelo
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
zgrab
zitebot
zmeu
zumbot
zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://iblbanca.it/sitemap.xml

Warnings

  • 7 invalid lines.