Log In Sign Up

despegar.net
robots.txt

Robots Exclusion Standard data for despegar.net

Resource Scan

Scan Details

Site Domain despegar.net
Base Domain despegar.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-04-08T17:24:03+00:00
Next Scan 2024-07-07T17:24:03+00:00

Last Successful Scan

Scanned2021-09-14T21:23:30+00:00
URL http://despegar.net/robots.txt
Found Yes
Hash e8950e3d77e13f61d63db042c149155f882b5affda7677141b79b51532568821
SimHash a014ec704128

Groups

*

Rule Path
Allow /promosvigentes/bo/
Allow /promosvigentes/cr/
Allow /promosvigentes/ec/
Allow /promosvigentes/sv/
Allow /promosvigentes/gt/
Allow /promosvigentes/hn/
Allow /promosvigentes/ni/
Allow /promosvigentes/pa/
Allow /promosvigentes/py/
Allow /promosvigentes/pe/
Allow /promosvigentes/pr/
Allow /promosvigentes/uy/
Disallow /promosvigentes/*/
Disallow /ayuda/search*
Disallow hoteles/landings*
Disallow /2001/
Disallow /2002/
Disallow /2003/
Disallow /cgi-bin/
Disallow /cobranded/
Disallow /desp/
Disallow /despegarCorp/
Disallow /entelpcs/
Disallow /site/
Disallow /span/
Disallow /STS/
Disallow /temp
Disallow /wap
Disallow /wapold
Disallow /Yahoo/
Disallow /yahoobr/
Disallow /ASPxGrid/
Disallow /backnet/
Disallow /Cancun2005/
Disallow /Checkout
Disallow /citibank/
Disallow /entelpcs/
Disallow /Error
Disallow /estatico/
Disallow /estilos/
Disallow /galeria/
Disallow /general/
Disallow /grhomes/
Disallow /grtemplates/
Disallow /hl
Disallow /ict
Disallow /imagen_t1msn/
Disallow /ImagesMapQuest/
Disallow /imagesNN/
Disallow /img/
Disallow /PingSabre/
Disallow /recomendacionpt_files/
Disallow /Agendaes_files/
Disallow /desp/
Disallow /despegarCorp/
Disallow /infoHotelpt_files/
Disallow /infoPuntaCana_files
Disallow /infoRDominicanapt_files
Disallow /infoVisaspt_files
Disallow /isapi
Allow /vuelos-baratos
Disallow /paginas
Disallow /Despegar.Business.Services/
Disallow /ezpublish/
Disallow /georigen/
Disallow /savecookie.asp
Disallow /search/
Disallow /Search/
Disallow /SEARCH/
Disallow /shop/
Disallow /Shop/
Disallow /SHOP/
Disallow /shopping/
Disallow /Shopping/
Disallow /SHOPPING/
Disallow /booking/
Disallow /Booking/
Disallow /BOOKING/
Disallow /beneficios/
Disallow /Beneficios/
Disallow /BENEFICIOS/
Disallow /contents/
Disallow /Contents/
Disallow /CONTENTS/
Disallow /credito
Disallow /Credito
Disallow /CREDITO
Allow /Search/Flights/AdvancedSearch
Disallow /gds-services-web/
Disallow /homes/
Disallow /Homes/
Disallow /HOMES/
Disallow /benefit-service/
Disallow /it/
Disallow /voos.html
Disallow /micrositios/
Disallow /Micrositios/
Disallow /MICROSITIOS/
Disallow /cruises/
Disallow /Cruises/
Disallow /CRUISES/
Disallow /advertising/
Disallow /Advertising/
Disallow /ADVERTISING/
Disallow /lpfrontend/
Disallow /Lpfrontend/
Disallow /LPFRONTEND/
Disallow /travelnetwork_terminos.asp
Disallow /travelnetwork_terminos_en.asp
Disallow /travelnetwork_terminos_pt.asp
Disallow /yahoo/
Disallow /Yahoo/
Disallow /YAHOO/
Disallow /yahoobr/
Disallow /Yahoobr/
Disallow /YAHOOBR/
Disallow /IpService/
Disallow /ipservice/
Disallow /IPSERVICE/
Disallow /IT/
Disallow /It/
Disallow /turismo/SiteServices/
Disallow /search/hotels/
Disallow /Hotels.Services/
Disallow /loggerjs/
Disallow /Loggerjs/
Disallow /hoteles/landinghotels/
Disallow /Hoteles/landinghotels/
Disallow /landing-hotels-web/
Disallow /cars/shop/
Disallow /Cars/shop/
Disallow /que-hacer-en-orlando/
Disallow /book/
Disallow /Book/
Disallow /BOOK/
Disallow /commercial-web/
Disallow /packages/
Disallow /PACKAGES/
Disallow /Packages/
Disallow /vuelos/handler/
Disallow /vuelos/Handler/
Disallow /vuelos/HANDLER/
Disallow /vuelos/sem/
Disallow /vuelos/Sem/
Disallow /vuelos/SEM/
Disallow /viajes_en_oferta/
Disallow /Taca/
Disallow /contactenos/
Disallow /homesv2/
Disallow /content/
Disallow /content/
Disallow /Lineas%20Aereas/
Disallow /amadeuscars/
Disallow /hoteles/search/
Disallow /hoteles/detail/
Disallow /hoteles/map/
Disallow /hoteles/ciudad/
Disallow /hoteis/cidade/
Disallow /hoteis/search/
Disallow /hoteis/detail/
Disallow /hoteis/map/
Disallow /emt-service/
Disallow /packages-static-content/
Allow /hoteles/pais/
Disallow /vuelos/detail/
Disallow /passagens-aereas/detail/
Disallow /vuelos/oneway/
Disallow /passagens-aereas/oneway/
Disallow /vuelos/roundtrip/
Disallow /passagens-aereas/roundtrip/
Disallow /accommodations/*
Disallow /trip/accommodations/*
Disallow /search/hotel/
Disallow /search/hotel/fullSearch/
Disallow /search/hotel/details/lastViewedHotels
Disallow /search/hotel/quickSearch
Disallow /search/hotel/filteredSearch
Disallow /search/hotel/details/availability/
Disallow /search/hotel/details/closestHotels/
Disallow /search/hotel/details/suggestedHotels
Disallow /search/hotel/quickSearch/
Disallow /search/hotel/summariesAndReviews/
Disallow /search/hotel/details/streetView/
Disallow /search/hotel/details/summary/
Disallow /search/hotel/details/reviews/
Disallow /Search/hotel/
Disallow /Search/hotel/fullSearch/
Disallow /Search/hotel/details/lastViewedHotels
Disallow /Search/hotel/quickSearch
Disallow /Search/hotel/filteredSearch
Disallow /Search/hotel/details/availability/
Disallow /Search/hotel/details/closestHotels/
Disallow /Search/hotel/details/suggestedHotels
Disallow /Search/hotel/quickSearch/
Disallow /Search/hotel/summariesAndReviews/
Disallow /Search/hotel/details/streetView/
Disallow /Search/hotel/details/summary/
Disallow /Search/hotel/details/reviews/
Disallow /search/Hotel/
Disallow /search/Hotel/fullSearch/
Disallow /search/Hotel/details/lastViewedHotels
Disallow /search/Hotel/quickSearch
Disallow /search/Hotel/filteredSearch
Disallow /search/Hotel/details/availability/
Disallow /search/Hotel/details/closestHotels/
Disallow /search/Hotel/details/suggestedHotels
Disallow /search/Hotel/quickSearch/
Disallow /search/Hotel/summariesAndReviews/
Disallow /search/Hotel/details/streetView/
Disallow /search/Hotel/details/summary/
Disallow /search/Hotel/details/reviews/
Disallow /Search/Hotel/
Disallow /Search/Hotel/fullSearch/
Disallow /Search/Hotel/details/lastViewedHotels
Disallow /Search/Hotel/quickSearch
Disallow /Search/Hotel/filteredSearch
Disallow /Search/Hotel/details/availability/
Disallow /Search/Hotel/details/closestHotels/
Disallow /Search/Hotel/details/suggestedHotels
Disallow /Search/Hotel/quickSearch/
Disallow /Search/Hotel/summariesAndReviews/
Disallow /Search/Hotel/details/streetView/
Disallow /Search/Hotel/details/summary/
Disallow /Search/Hotel/details/reviews/
Disallow /comunidadafiliados/resources/
Disallow /shop/flights/
Disallow /shop/flights/print/
Disallow /shop/flights/wishlist/
Disallow /shop/flights/data/
Disallow /shop/flights/results/
Disallow /cruises/shop/search/
Disallow /hoteles/h/print/
Disallow /hotels/h/print/
Disallow /hoteis/h/print/
Disallow /vacation-rentals/
Allow /paquetes/
Disallow /paquetes/sem/
Disallow /pacotes/
Disallow /pacotes/*
Disallow /packages/
Disallow /packages/*
Disallow /activities/
Disallow /activities/*
Disallow /atracoes-turisticas/
Disallow /atracoes-turisticas/*
Disallow /flights/
Disallow /flights/*
Disallow /passagens-aereas/
Disallow /passagens-aereas/*
Disallow /hotels/
Disallow /hotels/*
Disallow /hoteis/
Disallow /hoteis/*
Disallow /cars/
Disallow /cars/*
Disallow /pasajes-en-micro/shop
Disallow /passagens-de-onibus/shop
Disallow /AE_beneficios/
Disallow /beneficio_empleados/
Disallow /beneficio_topclub/
Disallow /beneficio-empleados/
Disallow /cajalosandes_beneficios/
Disallow /clubadelanteviajes/
Disallow /icbc-viajes/
Disallow /jumbomas/
Disallow /macro_premia/
Disallow /puntosbancomer/
Disallow /puntoscencosud/
Disallow /sams_beneficios/
Disallow /santanderplus/
Disallow /scotiabank_beneficios/
Disallow /superclub_canje/

adsbot-google

Rule Path
Disallow /book/
Disallow /car/shop/

baiduspider

Rule Path
Disallow /
Disallow /turismo/
Disallow /detail/hotel/services/reviews/summary/

google-hoteladsverifier

Rule Path
Disallow

*

Rule Path
Disallow /cache/
Disallow /configs/
Disallow /templates/
Disallow /util/
Disallow /vuelos/aerolineas/aerolineas-argentinas-2
Disallow /vuelos/aerolineas/latam-airlines-2
Disallow /vuelos/aerolineas/azul-linhas-aereas-2
Disallow /vuelos/aerolineas/avianca-2
Disallow /vuelos/aerolineas/gol-linhas-aereas-2
Disallow /autos/rentadoras/hertz-2
Disallow /autos/rentadoras/zr/dollar-2
Disallow /autos/rentadoras/zi/avis-2
Disallow /autos/rentadoras/al/alamo-2
Disallow /autos/rentadoras/localiza-2
Disallow /adv/
Allow /atracoes-turisticas/*/*/c-SHOW_EVENT/
Allow /actividades/*/*/c-SHOW_EVENT/
Disallow /me/
Disallow /promo-viagens/*
Disallow /promo-viajes/*
Disallow /paquetes/pais/aw/paquetes-a-aruba
Disallow /pacotes/pais/aw/pacotes-para-aruba
Disallow /cybermonday/*
Disallow /paquetes/vn2/paquetes-a-venecia
Disallow /buenfin/*
Disallow /cyberlunes/*
Disallow /black-friday/*
Disallow /tiendaclic/
Disallow /tiendaclic/*
Disallow /promocoes/*
Disallow /visitesaopaulo
Disallow /visitesaopaulo/
Disallow /visitesaopaulo/*
Disallow /ofertas-viajes/*
Allow /ofertas-viajes/semanasanta
Allow /ofertas-viajes/travelsale
Disallow /promociones/
Disallow /promociones/*
Allow /promociones-aereas/
Disallow /donde-viajar/mundo/results
Allow /ofertas-viajes/aniversario
Disallow /vuelos-multidestinos/
Disallow /vuelos-multidestinos/*
Disallow /reviews/*
Disallow /surveys/*
Disallow /survey/*
Disallow *package_id*
Allow /toure/getaways?*
Allow /toure/ch4/holidays?*
Allow /dreck/ajax/wrongcountry?*
Back to top

Comments

  • Robots default
  • Los siguientes 2 son de las nuevas landings de hoteles en destinos
  • Bloquea las landings de hoteles en pais
  • Disallow: /hoteis/pais/
  • Los siguientes 3 son por la estructura de urls de mobile
  • Allow para hoteles search
  • Bloquea paginas de hoteles version para imprimir
  • Paquetes
  • Actividades
  • Vuelos
  • Hoteles
  • Autos
  • Buses
  • Special clients
  • Bloqueos especificos para el bot de QualityScore de SEM
  • Bloqueo Baidu:
  • multidestinos
  • hermes
  • desbloqueo parametros 14-09-2021
  • Disallow: /dsg/*
  • Disallow: /hermes-service/*
  • Disallow: *?
Back to top