tokefinal.com.br
robots.txt
Robots Exclusion Standard data for tokefinal.com.br
Resource Scan
Scan Details
| Site Domain | tokefinal.com.br |
| Base Domain | tokefinal.com.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-11-01T20:01:48+00:00 |
| Next Scan | 2024-11-08T20:01:48+00:00 |
Last Successful Scan
| Scanned | 2024-10-01T16:42:17+00:00 |
| URL | https://tokefinal.com.br/robots.txt |
| Domain IPs | 18.155.68.59, 18.155.68.78, 18.155.68.86, 18.155.68.92, 2600:9000:23d2:1600:13:64ba:8a80:93a1, 2600:9000:23d2:2e00:13:64ba:8a80:93a1, 2600:9000:23d2:5200:13:64ba:8a80:93a1, 2600:9000:23d2:6a00:13:64ba:8a80:93a1, 2600:9000:23d2:9200:13:64ba:8a80:93a1, 2600:9000:23d2:9400:13:64ba:8a80:93a1, 2600:9000:23d2:c600:13:64ba:8a80:93a1, 2600:9000:23d2:fa00:13:64ba:8a80:93a1 |
| Response IP | 18.155.68.92 |
| Found | Yes |
| Hash | cc8dc2e09c061d2dafa667f6a9e2e8f364fd261674c76f8c7fd5232842951be5 |
| SimHash | fd65f2f189e3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /404/ |
| Disallow | /app/ |
| Disallow | /cgi-bin/ |
| Disallow | /debug/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /js/ |
| Disallow | /lib/ |
| Disallow | /magento/ |
| Disallow | /pkginfo/ |
| Disallow | /quickview/ |
| Disallow | /report/ |
| Disallow | /scripts/ |
| Disallow | /shell/ |
| Disallow | /skin/ |
| Disallow | /stats/ |
| Disallow | /var/ |
| Disallow | /productpageshipping/* |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /catalogsearch/ |
| Disallow | /checkout/ |
| Disallow | /checkout/onepage/ |
| Disallow | /checkout/onepage/billing/ |
| Disallow | /checkout/onepage/shipping/ |
| Disallow | /checkout/onepage/shipping_method/ |
| Disallow | /checkout/onepage/payment/ |
| Disallow | /checkout/onepage/review/ |
| Disallow | /checkout/onepage/success/ |
| Disallow | /onestepcheckout/ |
| Disallow | /onepagecheckout/ |
| Disallow | /control/ |
| Disallow | /contacts/ |
| Disallow | /customer/ |
| Disallow | /customer/account/ |
| Disallow | /customer/account/login/ |
| Disallow | /customize/ |
| Disallow | /newsletter/ |
| Disallow | /poll/ |
| Disallow | /review/ |
| Disallow | /sendfriend/ |
| Disallow | /tag/ |
| Disallow | /wishlist/ |
| Disallow | /cgi-bin/ |
| Disallow | /cleanup.php |
| Disallow | /apc.php |
| Disallow | /memcache.php |
| Disallow | /phpinfo.php |
| Disallow | /api.php |
| Disallow | /get.php |
| Disallow | /install.php |
| Disallow | /index.php/ |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /error_log |
| Disallow | /install.php |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /README.txt |
| Disallow | /RELEASE_NOTES.txt |
| Disallow | /STATUS.txt |
| Disallow | /CVS |
| Disallow | /*.Svn$ |
| Disallow | /*.Idea$ |
| Disallow | /*.Sql$ |
| Disallow | /*.Tgz$ |
| Disallow | /*.js$ |
| Disallow | /*.css$ |
| Disallow | /*.php$ |
| Disallow | /*?p=*& |
| Disallow | /*?SID= |
| Disallow | /*?limit=all |
| Disallow | /*?Limit=all |
| Disallow | /*?Dir* |
| Disallow | /*?dir* |
| Disallow | /*?Dir=desc |
| Disallow | /*?Dir=asc |
| Disallow | /*?dir=desc |
| Disallow | /*?dir=asc |
| Disallow | /*?mode* |
alexibot
ahrefsbot
aqua_products
backdoorbot
backdoorbot/1.0
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
black.hole
blackwidow
blowfish
blowfish/1.0
bookmark search tool
bot mailto:craftbot@yahoo.com
botalot
botrighthere
builtbottough
bullseye
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
copernic
copyrightcheck
crescent
crescent internet toolpak http ole control v.1.0
custo
disco
disco pump 3.0
disco pump 3.2
discofinder
dittospyder
download demon
download demon/3.2.0.8
download demon/3.5.0.11
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
express webpictures
express webpictures (www.express-soft.com)
extractorpro
eyenetie
fairad client
flaming attackbot
flashget
flashget webwasher 3.2
foobot
frontpage
frontpage [nc,or]
gaisbot
getright
getright/2.11
getright/3.1
getright/3.2
getright/3.3
getright/3.3.3
getright/3.3.4
getright/4.0.0
getright/4.1.0
getright/4.1.1
getright/4.1.2
getright/4.2
getright/4.2b (portuguxeas)
getright/4.2c
getright/4.3
getright/4.5
getright/4.5a
getright/4.5b
getright/4.5b1
getright/4.5b2
getright/4.5b3
getright/4.5b6
getright/4.5b7
getright/4.5c
getright/4.5d
getright/4.5e
getright/5.0beta1
getright/5.0beta2
getweb!
go!zilla
go!zilla (www.gozilla.com)
go!zilla 3.3 (www.gozilla.com)
go!zilla 3.5 (www.gozilla.com)
go-ahead-got-it
grabnet
grafula
hmview
httrack
httrack 3.0
httrack [nc,or]
harvest
harvest/1.5
image stripper
image sucker
indy library
indy library [nc,or]
infonavirobot
interget
internet ninja
internet ninja 4.0
internet ninja 5.0
internet ninja 6.0
iron33/1.0.2
joc web spider
jennybot
jetcar
kenjin spider
kenjin.spider
keyword density/0.9
keyword.density
lnspiderguy
leechftp
lexibot
linkscan/8.1a unix
linkscan/8.1a.unix
linkwalker
linkextractorpro
midown tool
miixpc
miixpc/4.2
msiecrawler
mass downloader
mass downloader/2.2
mata hari
mata.hari
microsoft url control
microsoft url control – 5.01.4511
microsoft url control – 6.00.8169
microsoft.url
mister pix
mister pix version.dll
mister pix ii 2.01
mister pix ii 2.02a
mister.pix
nicerspro
npbot
npbot
navroad
nearsite
net vampire
net vampire/3.0
netants
netants/1.10
netants/1.23
netants/1.24
netants/1.25
netmechanic
netspider
netzip
netzip downloader 1.0 win32(nov 12 1998)
netzip-downloader/1.0.62 (win32; dec 7 1998)
netzippy+(http://www.innerprise.net/usp-spider.asp)
octopus
offline explorer
offline explorer/1.2
offline explorer/1.4
offline explorer/1.6
offline explorer/1.7
offline explorer/1.9
offline explorer/2.0
offline explorer/2.1
offline explorer/2.3
offline explorer/2.4
offline explorer/2.5
offline navigator
offline.explorer
openbot
openfind
openfind data gatherer
oracle ultra search
pagegrabber
papa foto
perman
propowerbot/2.14
prowebwalker
python-urllib
queryn metasearch
queryn.metasearch
rma
radiation retriever 1.1
reget
realdownload
realdownload/4.0.0.40
realdownload/4.0.0.41
realdownload/4.0.0.42
repomonkey
repomonkey bait & tackle/v1.01
sitesnagger
slysearch
smartdownload
smartdownload/1.2.76 (win32; apr 1 1999)
smartdownload/1.2.77 (win32; aug 17 1999)
smartdownload/1.2.77 (win32; feb 1 2000)
smartdownload/1.2.77 (win32; jun 19 2001)
spankbot
sqworm/2.9.85-beta (beta_release; 20011115-775; i686-pc-linux
superbot
superbot/3.0 (win32)
superbot/3.1 (win32)
superhttp
superhttp/1.0
surfbot
szukacz/1.4
teleport
teleport pro
teleport pro/1.29
teleport pro/1.29.1590
teleport pro/1.29.1634
teleport pro/1.29.1718
teleport pro/1.29.1820
teleport pro/1.29.1847
teleportpro
telesoft
the intraformant
the.intraformant
thenomad
tighttwatbot
titan
true_robot
true_robot/1.0
turnitinbot
turnitinbot/1.5
url control
url_spider_pro
urly warning
urly.warning
vci
vci webviewer vci webviewer win32
voideye
www-collector-e
wwwoffle
web image collector
web sucker
web.imge.collector
webauto
webauto/3.40 (win98; i)
webbandit
webbandit/3.50
webcapture 2.0
webcopier
webcopier v.2.2
webcopier v2.5
webcopier v2.6
webcopier v2.7a
webcopier v2.8
webcopier v3.0
webcopier v3.0.1
webcopier v3.2
webcopier v3.2a
webemailextrac
webenhancer
webfetch
webgo is
webleacher
webreaper
webreaper [info@webreaper.net]
webreaper [webreaper@otway.com]
webreaper v9.1 – www.otway.com/webreaper
webreaper v9.7 – www.webreaper.net
webreaper v9.8 – www.webreaper.net
webreaper vwebreaper v7.3 – www,otway.com/webreaper
websauger
websauger 1.20b
websauger 1.20j
websauger 1.20k
webstripper
webstripper/2.03
webstripper/2.10
webstripper/2.12
webstripper/2.13
webstripper/2.15
webstripper/2.16
webstripper/2.19
webwhacker
webzip
webzip/2.75 (http://www.spidersoft.com)
webzip/3.65 (http://www.spidersoft.com)
webzip/3.80 (http://www.spidersoft.com)
webzip/4.0 (http://www.spidersoft.com)
webzip/4.1 (http://www.spidersoft.com)
webzip/4.21
webzip/4.21 (http://www.spidersoft.com)
webzip/5.0
webzip/5.0 (http://www.spidersoft.com)
webzip/5.0 pr1 (http://www.spidersoft.com)
webzip
webzip/4.0
webmasterworldforumbot
website quester
website quester – www.asona.org
website quester – www.esalesbiz.com/extra/
website extractor
website extractor (http://www.asona.org)
website.quester
webster pro
webster.pro
wget
wget/1.5.2
wget/1.5.3
wget/1.6
wget/1.7
wget/1.8
wget/1.8.1
wget/1.8.1+cvs
wget/1.8.2
wget/1.9-beta
widow
xaldon webspider
xaldon webspider 2.5.b3
xenu's
xenu's link sleuth 1.1c
zeus
zeus 11389 webster pro v2.9 win32
zeus 11652 webster pro v2.9 win32
zeus 18018 webster pro v2.9 win32
zeus 26378 webster pro v2.9 win32
zeus 30747 webster pro v2.9 win32
zeus 32297 webster pro v2.9 win32
zeus 39206 webster pro v2.9 win32
zeus 41641 webster pro v2.9 win32
zeus 44238 webster pro v2.9 win32
zeus 51070 webster pro v2.9 win32
zeus 51674 webster pro v2.9 win32
zeus 51837 webster pro v2.9 win32
zeus 63567 webster pro v2.9 win32
zeus 6694 webster pro v2.9 win32
zeus 71129 webster pro v2.9 win32
zeus 82016 webster pro v2.9 win32
zeus 82900 webster pro v2.9 win32
zeus 84842 webster pro v2.9 win32
zeus 90872 webster pro v2.9 win32
zeus 94934 webster pro v2.9 win32
zeus 95245 webster pro v2.9 win32
zeus 95351 webster pro v2.9 win32
zeus 97371 webster pro v2.9 win32
zeus link scout
asterias
b2w/0.1
cosmos
ecatch
ecatch/3.0
hloader
httplib
humanlinks
ia_archiver
larbin
larbin (samualt9@bigfoot.com)
larbin samualt9@bigfoot.com
larbin_2.6.2 (kabura@sushi.com)
larbin_2.6.2 (larbin2.6.2@unspecified.mail)
larbin_2.6.2 (listonatccdotgatechdotedu)
larbin_2.6.2 (vitalbox1@hotmail.com)
larbin_2.6.2 kabura@sushi.com
larbin_2.6.2 larbin2.6.2@unspecified.mail
larbin_2.6.2 larbin@correa.org
larbin_2.6.2 listonatccdotgatechdotedu
larbin_2.6.2 vitalbox1@hotmail.com
libweb/clshttp
lwp-trivial
lwp-trivial/1.34
moget
moget/2.1
pavuk
pingdom
pingdom gigrib
pingdom gigrib v1.1
pingdom.com_bot
pcbrowser
psbot
searchpreview
spanner
suzuran
takeout
tocrawl/urldispatcher
turingos
webfetch/2.1.0
wget
twengabot-2.0
etaospider
googlebot
googlebot-image
mediapartners-google
adsbot-google
No rules defined. All paths allowed.
Warnings
- 1 invalid line.
Comments