ottimax.it
robots.txt

Robots Exclusion Standard data for ottimax.it

Resource Scan

Scan Details

Site Domain ottimax.it
Base Domain ottimax.it
Scan Status Ok
Last Scan2024-06-14T15:02:19+00:00
Next Scan 2024-07-14T15:02:19+00:00

Last Scan

Scanned2024-06-14T15:02:19+00:00
URL https://www.ottimax.it/robots.txt
Domain IPs 104.40.186.116
Response IP 104.40.186.116
Found Yes
Hash 2eed9654975f4dfe5f353d236b2d4872e872a94c02e96bfadd0d9e0454c29ede
SimHash 73c57a334a86

Groups

*

Rule Path
Disallow /Admin/
Disallow /.well-known/

fdm
rma
vci
blow
bolt
drip
ecxi
evil
grub
iria
lftp
nmap
obot
pump
voil
wget
xenu
zade
zeus
zmeu
aibot
buddy
ccbot
custo
demon
deusu
devil
disco
fimap
gotit
havij
iblog
idbot
jetty
likse
ltx71
moget
naver
nikto
ninja
npbot
nutch
pavuk
psbot
reget
snake
spbot
spyfu
titan
toata
twice
vbseo
wesee
whack
widow
zauba
zgrab
abonti
aipbot
apexoo
attach
badass
bandit
bbbike
bdcbot
chlooe
coccoc
copier
cosmos
cshttp
daumoa
dblbot
diibot
dotbot
dumbot
easydl
ecatch
envolk
exabot
ezooms
fhscan
flunky
foobot
genieo
getweb
hmview
irlbot
jetcar
joomla
jorgee
larbin
libweb
magnet
miixpc
mojeek
mr.4x3
msrbot
needle
nessus
netzip
perman
pixray
pockey
pycurl
reaper
ripper
s1z.ru
sbider
scrapy
seomoz
shodan
siphon
smtbot
snoopy
sootle
sqlmap
sqworm
sucker
sucuri
t8abot
upflow
vacuum
webdav
webpix
webvac
webzip
woobot
wotbox
wpscan
yandex
zumbot
zyborg
admantx
aspseek
b2w/0.1
backweb
bdfetch
betabot
bigfoot
bitacle
blexbot
botalot
cheteam
curious
dnyzbot
dsearch
fyrebot
gaisbot
getweb!
gigabot
gozilla
grabber
grabnet
grafula
grapefx
gridbot
gt::www
harvest
hloader
httplib
httrack
ilsebot
iskanie
jyxobot
lexibot
mag-net
masscan
mauibot
metauri
mj12bot
msrabot
musobot
navroad
netants
nibbler
octopus
oncrawl
openbot
openvas
scanbot
semrush
sistrix
snapbot
spammen
spanner
spinn3r
sqlworm
steeler
surfbot
suzuran
sysscan
szukacz
takeout
thumbor
voideye
voltron
web pix
webalta
webauto
webfuck
webshag
webster
webwalk
whacker
whatweb
wprecon
zermelo
zitebot
aboundex
acunetix
adidxbot
aihitbot
alexibot
alphabot
anarchie
asterias
batchftp
blowfish
bullseye
buzzsumo
calculon
catchbot
cliqzbot
copernic
craftbot
crescent
discobot
dispatch
eccp/1.0
eyenetie
flashget
getright
go!zilla
haansoft
heritrix
instabid
interget
jamesbot
jbrofuzz
jennybot
justview
leechftp
leechget
linkscan
lmspider
naverbot
nearsite
netcraft
netlyzer
nettrack
netvibes
niki-bot
ogspider
openfind
phpcrawl
picscout
pxbroker
rankflex
recorder
rogerbot
roverbot
scan.lol
scoutjet
seokicks
seostats
sitebeam
sottopop
spankbot
stripper
superbot
swiftbot
teleport
telesoft
thenomad
turingos
turnitin
twiceler
typhoeus
virusdie
voilabot
web auto
web fuck
webfetch
webgo is
webwatch
wget/1.6
wwwoffle
zauba.io
abachobot
ahrefsbot
alligator
backrub/.
becomebot
bizbot003
builtwith
cegbfeieh
cheesebot
chinaclaw
cogentbot
collector
copyscape
crawler4j
crunchbot
datacha0s
digincore
dirbuster
dragonfly
dts agent
ebingbong
emailwolf
enigmabot
evc-batch
extractor
freecrawl
frontpage
galaxybot
getintent
gigablast
girafabot
golem/1.1
grapeshot
hybridbot
id-search
indeedbot
informant
ips-agent
kozmosbot
lipperhey
looksmart
markwatch
mata hari
merzscope
moget/2.1
motor/0.2
netspider
nicerspro
northstar
occam/1.0
orangebot
outfoxbot
panscient
papa foto
pcbrowser
peoplepal
picsearch
pimonster
rankurbot
scanalert
screaming
seznambot
sitevigil
slysearch
superhttp
surveybot
toweyabot
twengabot
vagabondo
web fetch
webbandit
webcopier
webferret
webreaper
websauger
websucker
wonderbot
youdaobot
aboutusbot
backstreet
barkrowler
beslistbot
black hole
blackboard
blackwidow
brandwatch
claritybot
deweb/1.01
ecatch/3.0
eirgrabber
email wolf
erocrawler
fdse robot
gromit/1.0
htmlparser
http::lite
humanlinks
infotekies
ingrid/0.1
istellabot
iti spider
jikespider
jubiirobot
katipo/1.0
lanshanbot
libwhisker
linkdexbot
linklooker
linkpadbot
linkwalker
majestic12
mediawords
metagopher
miixpc/4.2
mister pix
nomad-v2.x
pagepeeker
pagescorer
pecl::http
pgp-ka/1.2
pi-monster
rankactive
rankingbot
rankivabot
rebelmouse
repomonkey
semrushbot
sitesucker
sosospider
spacebison
sputnikbot
true_robot
unisterbot
vb project
web sauger
web sucker
webcollage
webleacher
webwhacker
webzip/4.0
wget/1.5.3
who.is bot
winhttrack
wisenutbot
x09mozilla
x22mozilla
aboundexbot
auresys/1.0
backdoorbot
baiduspider
big brother
boardreader
cazoodlebot
combine/0.0
discofinder
dittospyder
emailsiphon
extlinksbot
firefox/7.0
fyberspider
germcrawler
grub-client
gsa-crawler
happyfunbot
harvest/1.5
ia_archiver
image fetch
intelliseek
jumpstation
linguee bot
linkedinbot
lnspiderguy
lwp-request
lwp-trivial
lwp::simple
mail.ru_bot
markmonitor
meanpathbot
midown tool
mnogosearch
msfrontpage
msiecrawler
nameprotect
net vampire
netmechanic
page scorer
pagegrabber
pandalytics
pleasecrawl
probethenet
propowerbot
rankingbot2
redesscrapy
screenerbot
seoprofiler
seoscanners
serpstatbot
sexsearcher
site sucker
siteimprove
sitesnagger
sociscraper
sogouspider
sp_auditbot
szukacz/1.4
t0phackteam
teleportpro
telesphoreo
telesphorep
tracemyfile
trendiction
turnitinbot
url control
urlck/1.2.3
wbsearchbot
web collage
webenhancer
webster pro
webstripper
xpymep1.exe
allsubmitter
aspider/0.09
awariorssbot
blowfish/1.0
botrighthere
brandprotect
bullseye/1.0
cherrypicker
cognitiveseo
discoverybot
email siphon
extractorpro
felixide/1.0
freeuploader
getright/4.2
haosouspider
image sucker
indy library
internetseer
iron33/1.0.2
linksmanager
linqiarssbot
majestic seo
majestic-seo
meanpath bot
mediafox/x.y
megaindex.ru
muhstik-scan
nimbostratus
orangespider
outclicksbot
pageanalyzer
prowebwalker
realdownload
resume robot
searchestate
siteexplorer
tighttwatbot
ucsd-crawler
urly warning
urly.warning
wallpapershd
wasalive-bot
web enhancer
amznkassocbot
aqua_products
arachnophilia
backlink-ceck
builtbottough
bunnyslippers
catexplorador
cloud mapping
coccocbot-web
digitalpebble
domaincrawler
fairad client
g-i-g-a-b-o-t
headmasterseo
infonavirobot
kenjin spider
labelgrab/1.1
nimblecrawler
page analyzer
picturefinder
plumanalytics
python-urllib
quick-crawler
rocketcrawler
searchpreview
smartdownload
speedy spider
superhttp/1.0
www-mechanize
aitcsrobot/1.1
awariosmartbot
backlink-check
conceptbot/0.3
copyrightcheck
demandbase-bot
disco pump 3.0
disco pump 3.2
domainappender
domainstatsbot
download demon
emailcollector
explorersearch
femtosearchbot
hatena antenna
image stripper
internet ninja
joc web spider
libweb/clshttp
linkdexbot/2.1
magpie-crawler
neosciocrawler
nhsewalker/3.0
r6_feedfetcher
seokicks-robot
seositecheckup
sitelockspider
snooper/b97_01
trendiction.de
trendictionbot
true_robot/1.0
url_spider_pro
vidiblescraper
wallpapers/3.0
webbandit/3.50
websitequester
whowhere robot
wiseguys robot
www::mechanize
architextspider
archive.org_bot
autoemailspider
backdoorbot/1.0
backlinkcrawler
crawl.sogou.com
crazywebcrawler
cyberspyder/2.1
download wonder
facebookscraper
go-ahead-got-it
incywincy/1.0b1
keyword density
linqiascrapebot
litemage_walker
mass downloader
mediatoolkitbot
mfc_tear_sample
msr-isrccrawler
net vampire/3.0
senrigan/xxxxxx
socialrankiobot
trendiction.com
vericitecrawler
webmeup-crawler
website quester
www-collector-e
zeus link scout
abcdatos botlink
accoona-ai-agent
baiduspider-news
crawler.feedback
grapeshotcrawler
linkextractorpro
lipperhey spider
lwp-trivial/1.34
nextgensearchbot
offline explorer
openlinkprofiler
propowerbot/2.14
r6_commentreader
salesintelligent
searchmetricsbot
seolyticscrawler
sogou web spider
the intraformant
websiteextractor
xaldon webspider
xaldon_webspider
addsugarspiderbot
baiduspider-image
baiduspider-video
com.plumanalytics
fish-search-robot
flaming attackbot
israelisearch/1.0
lightspeedsystems
name intelligence
offline navigator
queryn metasearch
rankactivelinkbot
unwindfetchor/1.0
webimagecollector
battleztar bazinga
cherrypickerse/1.0
domainsigmacrawler
internet ninja 6.0
linkscan/8.1a unix
express webpictures
keyword density/0.9
mass downloader/2.2
oracle ultra search
safetynet robot 0.1
solbot/1.0 lwp/5.07
web image collector
a1 sitemap generator
afd-verbotsverfahren
bookmark search tool
databasedrivermysqli
huaweisymantecspider
netestate ne crawler
spyder3.microsys.com
checkbot/x.xx lwp/5.x
cherrypickerelite/1.0
internetvista monitor
microsoft data access
microsoft url control
openfind data gathere
realdownload/4.0.0.42
tocrawl/urldispatcher
download demon/3.2.0.8
extreme picture finder
flashget webwasher 3.2
webmasterworldforumbot
cactvs chemistry spider
download demon/3.5.0.11
inagist.com url crawler
morfeus fucking scanner
netcarta cyberpilot pro
radiation retriever 1.1
fido/0.9 harvest/1.4.pl2
netscoop/1.0 libwww/5.0a
webmasterworld extractor
ahoy! the homepage finder
hazel's ferret web hopper
poe-component-client-http
cyberpatrol sitecat webbot
linqiametadatadownloaderbot
open text site crawler v1.0
valkyrie/1.0 libwww-perl/0.40
repomonkey bait & tackle/v1.01
momspider/1.00 libwww-perl/0.40
ms web services client protocol
spanner/1.0 (linux 2.0.27 i586)
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
vci webviewer vci webviewer win32
zeus 32297 webster pro v2.9 win32
mozilla/4.0 (compatible; bullseye; windows 95)
crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /

Warnings

  • 7 invalid lines.