itabike.com.br
robots.txt

Robots Exclusion Standard data for itabike.com.br

Resource Scan

Scan Details

Site Domain itabike.com.br
Base Domain itabike.com.br
Scan Status Ok
Last Scan2024-05-25T03:06:31+00:00
Next Scan 2024-06-24T03:06:31+00:00

Last Scan

Scanned2024-05-25T03:06:31+00:00
URL https://itabike.com.br/robots.txt
Redirect https://www.itabike.com.br/robots.txt
Redirect Domain www.itabike.com.br
Redirect Base itabike.com.br
Domain IPs 45.67.216.158
Redirect IPs 52.84.229.115, 52.84.229.30, 52.84.229.54, 52.84.229.83
Response IP 52.84.229.83
Found Yes
Hash 999199df67583c412a6355e5e0976d0d8d66d8feb65bef1e86a749ff860aaac1
SimHash 7ab56df2bd10

Groups

*

Rule Path
Allow

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

mediapartners-google

Rule Path
Allow

adsbot-google

Rule Path
Disallow /*?sort
Disallow /*%26sort
Disallow /*?order
Disallow /*%26order
Disallow /*?limit
Disallow /*%26limit
Disallow /*%26search
Disallow /*%26description
Disallow /*%26category_id
Disallow /*%26filter
Disallow /*?page=1
Disallow /*?keyword
Disallow /*?route=checkout
Disallow /*?route=account
Disallow /*?route=module%2Ffiltros%2Fget_filtros
Disallow /login
Disallow /minha_conta
Disallow /alterar_informacoes
Disallow /alterar_senha
Disallow /enderecos
Disallow /lista_de_desejos
Disallow /pedidos
Disallow /transacoes
Disallow /newsletter
Disallow /logout
Disallow /checkout/carrinho
Disallow /checkout/pagamento
Disallow /?route=affiliate%2Faccount
Disallow /?route=affiliate%2Fpayment
Disallow /?route=affiliate%2Ftracking
Disallow /?route=affiliate%2Ftransaction
Disallow /?route=affiliate%2Fforgotten
Disallow /?route=affiliate%2Fregister
Disallow /admin/
Disallow /system/
Disallow /catalog/

tailbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

ws nutch/solr/nutch-1.9

Rule Path
Disallow /

riddler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

exabot

Rule Path
Disallow /

snoothbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

daum

Rule Path
Disallow /

amazonec2

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

a6-indexer/1.0

Rule Path
Disallow /

wesee

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

ng/2.0

Rule Path
Disallow /

crystalsemantics

Rule Path
Disallow /

f-six

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

scrapybot

Rule Path
Disallow /

vocusbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ezooms.bot

Rule Path
Disallow /

skimlinks.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

wikiwix-bot

Rule Path
Disallow /

semantissimo

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

lemonsources

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

ltbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

language-tools.com

Rule Path
Disallow /

trec-kba-bot

Rule Path
Disallow /

checkprivacy.or.kr

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

socialradarbot

Rule Path
Disallow /

havij

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mireobot

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

bot clicker

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

exaleadcloudview

Rule Path
Disallow /

admedia

Rule Path
Disallow /

grepnetstat.com

Rule Path
Disallow /

genieo

Rule Path
Disallow /

nerdbynature

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sindup

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

netseer.com

Rule Path
Disallow /

nagios

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

ning/1.0

Rule Path
Disallow /

feedretriever

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

argus presse

Rule Path
Disallow /

ibm ica crawler

Rule Path
Disallow /

nutch agent

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

linkscrawler

Rule Path
Disallow /

archive.org

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

mynutchtest

Rule Path
Disallow /

admantx

Rule Path
Disallow /

genieo.com

Rule Path
Disallow /

mixdata.com

Rule Path
Disallow /

www.wise-guys.nl

Rule Path
Disallow /

www.wesee.com

Rule Path
Disallow /

www.200please.com

Rule Path
Disallow /

ubermetrics-technologies

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

wasalive

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /
Allow /

Other Records

Field Value
sitemap https://www.itabike.com.br/sitemap.xml