softairrastelli.com
robots.txt
Robots Exclusion Standard data for softairrastelli.com
Resource Scan
Scan Details
| Site Domain | softairrastelli.com |
| Base Domain | softairrastelli.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2026-01-09T18:37:07+00:00 |
| Next Scan | 2026-04-09T18:37:07+00:00 |
Last Successful Scan
| Scanned | 2025-08-20T05:28:33+00:00 |
| URL | https://softairrastelli.com/robots.txt |
| Domain IPs | 185.21.118.120 |
| Response IP | 185.21.118.120 |
| Found | Yes |
| Hash | 51ad466d6cf881f44627d491c44e170344cc914e8b4f7abe7e39a8033a627d95 |
| SimHash | f375d34f0187 |
Groups
aspseek
abachobot
ahrefsbot
b2w
blexbot
backdoorbot
backweb
baidu
baiduspider
bandit
batchftp
blackwidow
black\ hole
blowfish
botalot
bot\ mailto
bot\ mailto:craftbot@yahoo.com
buddy
builtbottough
bullseye
bunnyslippers
coast\ webmaster
cheesebot
cherrypicker
cherrypickerse
cherrypickerelite
chinaclaw
clariabot
coldfusion
collector
copier
copyrightcheck
crescent
custo
da
disco
disco\ pump
dts\ agent
diamond
dittospyder
dotbot
download\ demon
download\ wonder
downloader
drip
easydl
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
express\ webpictures
extractorpro
extreme\ picture\ finder
eyenetie
ezooms
fast\ webcrawler
fetch\ api\ request
filehound
flashget
flickbot
freefind.com
frontpage
getsmart
getright
getweb!
generic
gigabot
go!zilla
go-ahead-got-it
grabber
grabnet
grafula
gulliver
hmview
httptrack
httpapp
httpviewer
httrack
harvest
heretrix
hitboxdoctor
irlbot
image\ stripper
image\ sucker
indy\ library
infonavirobot
interget
internetseer.com
internet\ ninja
iria
joc
joc\ web\ spider
java
jennybot
jetcar
jobo
jonzilla
justview
kenjin\ spider
keyword\ density
lachesis
leechftp
lexibot
libby_
link
linkscan
linkwalker
linkextractorpro
mfc_tear_sample
midown\ tool
miixpc
mj12bot
msfrontpage
msiecrawler
mag-net
magnet
mass\ downloader
mata\ hari
memo
mercator
metacarta
mewsoft\ search\ engine
microsofturl
microsoft\ url\ control
mirror
missigua
mister\ pix
nicerspro
npbot
nationaldirectory\ webspider
navroad
nearsite
netants
netmechanic
netresearchserver
netspider
netzip
net\ probe
net\ vampire
nikto
ninja
octopus
offline\ explorer
offline\ navigator
openfind
openfind\ data\ gatherer
orangebot
php
php\ version
phpot
pagegrabber
papa\ foto
perl
ping
pingalink\ monitoring\ services
pockey
pompos
prowebwalker
propowerbot
pump
python-urllib
python\ urllib
queryn
rma
reget
realdownload
reaper
recorder
repomonkey
rico
robozilla
rogerbot
scooter
scoutabout
siphon
sitesnagger
smartdownload
snake
snapbot
snoopy
spacebison
spankbot
spinne
stealer
stripper
sucker
superhttp
superbot
surfbot
sqworm
szukacz
teleport\ pro
telesoft
tighttwatbot
titan
thenomad
the\ intraformant
true_robot
turnitinbot
urly\ warning
urldispatcher
vci
vacuum
vagabondo
vayala
vintage
voideye
w3c_validator
www-collector-e
wwwoffle
webauto
webcopier
webenhancer
webfetch
webgo\ is
webleacher
webreaper
websauger
webstripper
webviewer
webwhacker
webzip
webzip
web\ downloader
web\ image\ collector
web\ sucker
webdownloader
webhook
webminer
webmirror
webmole
website
website\ extractor
website\ quester
websites
webster
webster\ pro
websucker
wells
wget
whacker
widow
wildsoft\ surfer
winhttp
winhttprequest
xaldon
xaldon\ webspider
xara
xenu
y!tunnelpro
yahooysmcm
yandexbot
zbot
zade
zeus
anarchie
antibot
appie
asterias
attach
autoemailspider
bumblebee
clshttp
cosmos
curl
cybo.com
dloader
ecatch
gotit
hloader
httpfetcher
httplib
httpscraper
humanlinks
larbin
lftp
libweb
libwww-perl
libwwwperl
likse
lwp-trivial
lwp\ request
moget
msnbot
nexuscache
obot
onestop
our\ agent
pavuk
pcbrowser
psbot
psycheclone
semalt.com
sitecheck.internetseer.com
slysearch
spanner
suzuran
takeout
tocrawl
turingos
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /lib/ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /var/ |
| Disallow | /catalog/ |
| Disallow | /customer/ |
| Disallow | /sendfriend/ |
| Disallow | /review/ |
| Disallow | /*SID%3D |
| Disallow | /checkout/ |
| Disallow | /onestepcheckout/ |
| Disallow | /customer/ |
| Disallow | /customer/account/ |
| Disallow | /customer/account/login/ |
| Disallow | /catalogsearch/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /dev/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /tag/ |
| Disallow | /review/ |
| Disallow | /composer.json |
| Disallow | /composer.lock |
| Disallow | /composer.phar |
| Disallow | /CONTRIBUTING.md |
| Disallow | /CONTRIBUTOR_LICENSE_AGREEMENT.html |
| Disallow | /COPYING.txt |
| Disallow | /Gruntfile.js |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /nginx.conf.sample |
| Disallow | /package.json |
| Disallow | /php.ini.sample |
| Disallow | /RELEASE_NOTES.txt |
| Disallow | /*?*product_list_mode= |
| Disallow | /*?*product_list_order= |
| Disallow | /*?*product_list_limit= |
| Disallow | /*?*product_list_dir= |
| Disallow | /*?dir* |
| Disallow | /*?dir=desc |
| Disallow | /*?dir=asc |
| Disallow | /*?limit=all |
| Disallow | /*?mode* |
| Disallow | /*.git |
| Disallow | /*.CVS |
| Disallow | /*.Zip$ |
| Disallow | /*.Svn$ |
| Disallow | /*.Idea$ |
| Disallow | /*.Sql$ |
| Disallow | /*.Tgz$ |
| Disallow | /ajax |
| Disallow | /homefort |
| Disallow | /prodotti-comparatori |
| Disallow | /da-catalogare |
googlebot
bingbot
| Rule | Path |
|---|---|
| Disallow | /*?p=*& |
| Disallow | /*?p=*%3F |
| Disallow | /*?marchio* |
| Disallow | /*?price* |
| Disallow | /*?manufacturer* |
| Disallow | /*?product_specificity* |
| Disallow | /*?drug_type* |
| Disallow | /*?limit* |
| Disallow | /*?order* |
| Disallow | /*?cat* |
| Disallow | /*?ajax-page* |
| Disallow | /*?awc* |
| Disallow | /*?reviews=* |
| Disallow | /*?dir=* |
| Disallow | *customer/account/login/referer/* |
| Disallow | *review/* |
| Disallow | /*?rating=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.softairrastelli.com/media/sitemap/sitemap_it.xml |
| sitemap | https://www.softairrastelli.com/media/sitemap/sitemap_en.xml |
Comments