vivino.com
robots.txt

Robots Exclusion Standard data for vivino.com

Resource Scan

Scan Details

Site Domain vivino.com
Base Domain vivino.com
Scan Status Ok
Last Scan2024-11-09T17:48:28+00:00
Next Scan 2024-11-16T17:48:28+00:00

Last Scan

Scanned2024-11-09T17:48:28+00:00
URL https://vivino.com/robots.txt
Redirect https://www.vivino.com/robots.txt
Redirect Domain www.vivino.com
Redirect Base vivino.com
Domain IPs 108.157.254.2, 108.157.254.34, 108.157.254.59, 108.157.254.64
Redirect IPs 108.157.254.2, 108.157.254.34, 108.157.254.59, 108.157.254.64
Response IP 108.157.254.2
Found Yes
Hash 2bf98c220e40c8128c7b5866bbc3708eb314c4749bcccef39d2ced23859a7d7d
SimHash 339f2e408cf2

Groups

*

Rule Path
Disallow /ajax/
Disallow /carts
Disallow /carts/*
Disallow /wine-searcher/
Disallow /prices/
Disallow /activities/*/comments
Disallow /activities/*/likes
Disallow /reviews/
Disallow /*/buying-guides
Disallow /external/
Disallow /wines/*/widgets
Disallow /login/googleplus
Disallow /add_to_wine_list
Disallow /remove_from_wine_list
Disallow /add_to_wishlist
Disallow /remove_from_wishlist
Disallow /comments
Disallow /likes
Disallow /users/likes
Disallow /users/like_activity
Disallow /users/unlike_activity
Disallow /activities/unlike
Disallow /activities/like
Disallow /menu/
Disallow /users/comments
Disallow /users/comment_activity
Disallow /users/unfollow
Disallow /users/wine_style_ambassadors
Disallow /users/*/country_rankings
Disallow /users/*/wine_style_widget
Disallow /users/*/wishlist
Disallow /users/*/following
Disallow /users/*/followers
Disallow /wineries/*/most_popular_vintages
Disallow /wines/user_vintage_descriptions
Disallow /wine-countries/offers
Disallow /wineries/*/wines/*/vivino-checkout
Disallow /wines/*/vivino-checkout
Disallow /vivino_checkout_t_and_c
Disallow /vivino_checkout_t_and_c.pdf
Disallow /vivino_checkout_t_and_c_apac.pdf
Disallow /vivino_checkout_t_and_c_europe.pdf
Disallow /vivino_checkout_t_and_c_uk.pdf
Disallow /vivino_checkout_t_and_c_us.pdf
Disallow /merchant_shipping_policy.pdf

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

exabot

Rule Path
Disallow /

snoothbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

daum

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

wesee

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

crystalsemantics

Rule Path
Disallow /

f-six

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

scrapybot

Rule Path
Disallow /

vocusbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ezooms.bot

Rule Path
Disallow /

skimlinks.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

wikiwix-bot

Rule Path
Disallow /

semantissimo

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

lemonsources

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

ltbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

language-tools.com

Rule Path
Disallow /

trec-kba-bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

socialradarbot

Rule Path
Disallow /

havij

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mireobot

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

bot clicker

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

exaleadcloudview

Rule Path
Disallow /

admedia

Rule Path
Disallow /

grepnetstat.com

Rule Path
Disallow /

genieo

Rule Path
Disallow /

nerdbynature

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sindup

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

netseer.com

Rule Path
Disallow /

nagios

Rule Path
Disallow /

feedretriever

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

argus presse

Rule Path
Disallow /

ibm ica crawler

Rule Path
Disallow /

nutch agent

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

linkscrawler

Rule Path
Disallow /

archive.org

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

mynutchtest

Rule Path
Disallow /

admantx

Rule Path
Disallow /

genieo.com

Rule Path
Disallow /

mixdata.com

Rule Path
Disallow /

ubermetrics-technologies

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

wasalive

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vivino.com/sitemap.xml

Comments

  • Sitemap files