sura.co
robots.txt

Robots Exclusion Standard data for sura.co

Resource Scan

Scan Details

Site Domain sura.co
Base Domain sura.co
Scan Status Ok
Last Scan2024-09-15T00:50:52+00:00
Next Scan 2024-10-15T00:50:52+00:00

Last Scan

Scanned2024-09-15T00:50:52+00:00
URL https://sura.co/robots.txt
Redirect https://www.sura.co/robots.txt
Redirect Domain www.sura.co
Redirect Base sura.co
Domain IPs 34.36.83.67
Redirect IPs 34.36.83.67
Response IP 34.36.83.67
Found Yes
Hash 923aada74c2678ad59e2f8bc82eaed285af0d86c3765a1646346d3bc3bf71cba
SimHash e7027b660a6a

Groups

abonti
aboundex
acapbot
acoonbot
acunetix
admantx
afd-verbotsverfahren
aibot
aihitbot
aipbot
alexibot
alligator
allsubmitter
alphabot
alphaseobot
alphaseobot-sa
alvinetspider
anarchie
antenne hatena
apexoo
apocalxexplorerbot
aspseek
asterias
attach
attackbot
autoemailspider
backdoorbot
backdorbot
backlink-ceck
backlink-check
backlinkcrawler
backstreet
backweb
badass
baidu
baiduspider
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-image
baiduspider-news
baiduspider-video
bandit
barkrowler
batchftp
bbbike
bdcbot
bdfetch
becomebot
betabot
bigfoot
binlar
bitacle
bizinformation
black hole
blackboard
blackwidow
blekkobot
blexbot
blow
blowfish
blowfish/1.0
boardreader
bolt
botalot
brandprotect
brandwatch
bubing
buddy
builtbottough
bullseye
bullseye/1.0
bunnys
bunnyslippers
butterfly
buzzsumo
calculon
careerbot
casper
catexplorador
cazoodlebot
ccbot
cegbfeieh
checkpriv
cheesebot
cherrypick
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
chlooe
choppy
claritybot
cliqzbot
clshttp
cmsworld
coccocbot-web
cogentbot
cognitiveseo
collector
com.plumanalytics
copernic
copier
copyrightcheck
copyscape
cosmos
craftbot
crawler.feedback
crawler4j
crazywebcrawler
crescent
crescent internet toolpak http ole control v.1.0
cshttp
curious
custo
cy_cho
databasedrivermysqli
datacha
datacha0s
dblbot
demandbase-bot
demon
deusu
devil
diavol
digincore
digitalpebble
diibot
dirbuster
disco
disco pump 3.1
discobot
discoverybot
dittospyder
dnyzbot
doc
domainappender
domaincrawler
domainsigmacrawler
domainstatsbot
dotbot
dotnetdotcom
download ninja
download wonder
dragonfly
drip
dts agent
dumbot
easydl
ebingbong
ecatch
eccp/1.0
ecxi
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
etaospider
evc-batch
evil
exabot
express webpictures
extlinksbot
extract
extractor
extractorpro
extreme picture finder
eyenetie
ezooms
fast
fdm
feedfinder
femtosearchbot
fetch
fhscan
fimap
flaming
flamingo_searchengine
flashget
flicky
flunky
foobot
fq
freeuploader
frontpage
fyrebot
g00g1e
galaxybot
genieo
germcrawler
getintent
getright
getweb
gigablast
gigabot
g-i-g-a-b-o-t
go!zilla
go-ahead-got
go-ahead-got-it
gotit
gozilla
grabber
grabnet
grafula
grapefx
grapeshot
grapeshotcrawler
gridbot
grub-client
gt::www
haansoft
haosouspider
harvest
harvest/1.5
havij
headmasterseo
heritrix
hloader
hmview
http::lite
httrack
httrack 3.0
humanlinks
hybridbot
ia_archiver
iblog
icarus6j
idbot
id-search
igentia
ilsebot
image fetch
image sucker
indeedbot
indy library
infonavirobot
infotekies
instabid
intelliseek
interget
internet ninja
internetseer
internetvista monitor
ips-agent
iria
irlbot
iskanie
istellabot
jamesbot
jbrofuzz
jennybot
jetbot
jetcar
jikespider
joc web spider
jorgee
justview
jyxobot
k2spider
kenjin spider
keyword density
keyword density/0.9
kmccrew
kozmosbot
lanshanbot
larbin
leechftp
leechget
lexibot
lftp
libweb
libweb/clshttp
libwhisker
libwww
lightspeedsystems
likse
linkdexbot
linkextractor
linkextractorpro
linko
linkpadbot
linkscan
linksmanager
linkwalker
linqiametadatadownloaderbot
linqiarssbot
linqiascrapebot
lipperhey
litemage_walker
lmspider
lnspiderguy
loader
ltx71
lwp::simple
lwp-request
lwp-trivial
lwp-trivial/1.34
magnet
mag-net
magpie-crawler
mail.ru_bot
majestic12
markmonitor
markwatch
mass downloader
masscan
mata hari
mauibot
meanpathbot
mechanize
mediawords
megaindex.ru
metauri
mfc_tear_sample
microsoft.url.control
midown tool
miixpc
miixpc/4.2
miner
mister pix
mj12bot
mlbot
moget
moget/2.1
mojeek
morfeus
morfeus fucking scanner
moveoverbot
ms search 4.0 robot
ms search 5.0 robot
msfrontpage
msiecrawler
msrabot
muhstik-scan
musobot
nameprotect
naverbot
navroad
nearsite
needle
nessus
net vampire
netants
netattache
netcraft
netlyzer
netmechanic
netspider
nettrack
netvibes
netzip
nextgensearchbot
nibbler
nicerspro
niki-bot
nikto
nimblecrawler
ninja
nmap
npbot
nutch
nyu
obot
octopus
offline explorer
offline navigator
openfind
openindexspider
openlinkprofiler
openvas
orangebot
orangespider
outclicksbot
outfoxbot
pageanalyzer
pagegrabber
pagescorer
panscient
papa foto
pavuk
pcbrowser
pecl::http
peoplepal
petalbot
phpcrawl
picscout
picsearch
picturefinder
pimonster
pi-monster
pixray
planetwork
pleasecrawl
plumanalytics
pockey
poe-component-client-http
postrank
probethenet
propowerbot
propowerbot/2.14
prowebwalker
proximic
psbot
pump
purebot
quepasacreep
queryn
queryn metasearch
queryseeker
radian6
radiation
rankactive
rankactivelinkbot
rankflex
rankingbot
rankingbot2
rankivabot
rankurbot
realdownload
reaper
rebelmouse
recorder
redesscrapy
reget
repomonkey
ripper
rma
rocketcrawler
rogerbot
salesintelligent
sbider
scan.lol
scanalert
scanbot
scooter
scrapy
screenerbot
searchestate
searchmetricsbot
seekerspider
semalt
sexsearcher
seznam
seznambot
shodan
siclab
sightupbot
sindice
siphon
sitebeam
sitebot
sitecheck.internetseer.com
siteexplorer
siteimprove
sitelockspider
sitesnagger
sitesucker
sitevigil
skygrid
slackbot-linkexpanding
slysearch
smartdownload
smtbot
snake
snapbot
snoopy
socialrankiobot
sogou inst spider
sogou spider2
sogou web spider
sosospider
sottopop
spacebison
spammen
spankbot
spanner
spbot
speedy
spinn3r
sputnikbot
sqlmap
sqlworm
sqworm
stackrambler
steeler
stripper
sucker
sucuri
suggybot
superbot
superbot/2.6
superhttp
surfbot
surftbot
surveybot
sux0r
suzukacz
suzuran
swiftbot
sysscan
szukacz
szukacz/1.4
t0phackteam
t8abot
takeout
teleport
teleportpro
telesoft
telesphoreo
telesphorep
the intraformant
thenomad
tighttwatbot
titan
toata
tocrawl/urldispatcher
toscrawler
toweyabot
trendiction
trendiction.com
trendiction.de
trendictionbot
true_robot
true_robot/1.0
true_robots
turingos
turnit
turnitin
turnitinbot
twengabot
twice
typhoeus
ubicrawler
unisterbot
urlpouls
urly.warning
vacuum
vagabondo
vampire
vci
vericitecrawler
vidiblescraper
vikspider
virusdie
voideye
voil
voltron
wallpapers/3.0
wallpapershd
wasalive-bot
wbsearchbot
webalta
webauto
webbandit
webbandit/3.50
webcollage
webcopier
webcopier v.2.2
webcopier v3.2a
webcopy
webdav
webenhancer
webfetch
webfuck
webgo is
webimagecollector
webleacher
webmasterworldforumbot
webmeup-crawler
webmirror
webpix
webreaper
websauger
webshag
website extractor
websiteextractor
websitequester
webster
webster pro
webstripper
webstripper/2.02
websucker
webvac
webviewer
webwhacker
webzip
wesee
wget
whack
whacker
whatweb
widow
wikiofeedbot
winhttp
winhttrack
wiseguys robot
wisenutbot
wonderbot
woobot
wotbox
woxbot
wprecon
wpscan
www::mechanize
www-collector-e
www-mechanize
wwwoffle
x09mozilla
x22mozilla
xaldon
xaldon_webspider
xenu
xenu link sleuth/1.3.8
xenu's
xenu's link sleuth 1.1c
xpymep1.exe
xxxyy
yacy
yahoo! slurp china
yamanalab
yandex
yandexbot
yandeximages
yioopbot
yisouspider
youda
youdaobot
yrspider
zade
zao
zauba
zauba.io
zealbot
zermelo
zeus
zeus link scout
zgrab
zitebot
zmeu
zookabot
zumbot
zune
zyborg

Rule Path
Disallow /

adsbot-google
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /*buscador*
Disallow /*search*
Disallow /*LoginPortlet*
Disallow */o/portal*
Disallow */o/staging*
Disallow */es/*
Disallow */es-ar/*
Disallow */es-bo/*
Disallow */es-cl/*
Disallow */es-co/*
Disallow */es-cr/*
Disallow */es-do/*
Disallow */es-ec/*
Disallow */es-es/*
Disallow */es-gt/*
Disallow */es-hn/*
Disallow */es-mx/*
Disallow */es-ni/*
Disallow */es-pa/*
Disallow */es-pe/*
Disallow */es-pr/*
Disallow */es-py/*
Disallow */es-sv/*
Disallow */es-uy/*
Disallow */es-ve/*
Disallow /group/*
Disallow /home
Disallow /c/document_library
Disallow /o/calendar-web
Disallow /?pid=9PON3266C
Disallow /o/classic-theme/images
Disallow /o/commerce-frontend-impl
Disallow /o/commerce-product-content-web
Disallow /o/contacts-web
Disallow /o/document-library-web
Disallow /o/dynamic-data-mapping-web
Disallow /o/exportimport-web
Disallow /o/frontend-editor-alloyeditor-web
Disallow /o/frontend-editor-ckeditor-web
Disallow /o/frontend-taglib
Disallow /o/invitation-invite-members-web
Disallow /o/item-selector-taglib
Disallow /o/journal-web
Disallow /o/product-navigation-taglib
Disallow /o/oauth2/redirect
Disallow /o/oauth2/authorize

Other Records

Field Value
sitemap https://www.sura.co/sitemap.xml

Comments

  • Sura Robots
  • Version: V1.4
  • Updated: 12.AGO.2024
  • Bad Bot Count: 649
  • Equipo SEO Sura
  • TRATAMIENTO DE BOTS NEGATIVOS
  • EVITA BLOQUEOS BOTS DE PAUTA Y REDES SOCIALES
  • DISALLOW DIRECTORIOS
  • DISALLOW URLs ESPECIFICAS
  • SITEMAPS
  • ________
  • __,_, | |
  • [_|_/ | Sura |
  • // |________|
  • _// __ /
  • (_|) |@@|
  • \ \__ \--/ __
  • \o__|----| | __
  • \ }{ /\ )_ / _\
  • /\__/\ \__O (__
  • (--/\--) \__/
  • _)( )(_
  • `---''---`

Warnings

  • 5 invalid lines.