despegar.it
robots.txt

Robots Exclusion Standard data for despegar.it

Resource Scan

Scan Details

Site Domain despegar.it
Base Domain despegar.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-08T20:13:34+00:00
Next Scan 2024-07-07T20:13:34+00:00

Last Successful Scan

Scanned2021-09-14T21:10:14+00:00
URL http://www.despegar.it/robots.txt
Found Yes
Hash e8950e3d77e13f61d63db042c149155f882b5affda7677141b79b51532568821
SimHash a014ec704128

Groups

*

Rule Path
Allow /promosvigentes/bo/
Allow /promosvigentes/cr/
Allow /promosvigentes/ec/
Allow /promosvigentes/sv/
Allow /promosvigentes/gt/
Allow /promosvigentes/hn/
Allow /promosvigentes/ni/
Allow /promosvigentes/pa/
Allow /promosvigentes/py/
Allow /promosvigentes/pe/
Allow /promosvigentes/pr/
Allow /promosvigentes/uy/
Disallow /promosvigentes/*/
Disallow /ayuda/search*
Disallow hoteles/landings*
Disallow /2001/
Disallow /2002/
Disallow /2003/
Disallow /cgi-bin/
Disallow /cobranded/
Disallow /desp/
Disallow /despegarCorp/
Disallow /entelpcs/
Disallow /site/
Disallow /span/
Disallow /STS/
Disallow /temp
Disallow /wap
Disallow /wapold
Disallow /Yahoo/
Disallow /yahoobr/
Disallow /ASPxGrid/
Disallow /backnet/
Disallow /Cancun2005/
Disallow /Checkout
Disallow /citibank/
Disallow /entelpcs/
Disallow /Error
Disallow /estatico/
Disallow /estilos/
Disallow /galeria/
Disallow /general/
Disallow /grhomes/
Disallow /grtemplates/
Disallow /hl
Disallow /ict
Disallow /imagen_t1msn/
Disallow /ImagesMapQuest/
Disallow /imagesNN/
Disallow /img/
Disallow /PingSabre/
Disallow /recomendacionpt_files/
Disallow /Agendaes_files/
Disallow /desp/
Disallow /despegarCorp/
Disallow /infoHotelpt_files/
Disallow /infoPuntaCana_files
Disallow /infoRDominicanapt_files
Disallow /infoVisaspt_files
Disallow /isapi
Allow /vuelos-baratos
Disallow /paginas
Disallow /Despegar.Business.Services/
Disallow /ezpublish/
Disallow /georigen/
Disallow /savecookie.asp
Disallow /search/
Disallow /Search/
Disallow /SEARCH/
Disallow /shop/
Disallow /Shop/
Disallow /SHOP/
Disallow /shopping/
Disallow /Shopping/
Disallow /SHOPPING/
Disallow /booking/
Disallow /Booking/
Disallow /BOOKING/
Disallow /beneficios/
Disallow /Beneficios/
Disallow /BENEFICIOS/
Disallow /contents/
Disallow /Contents/
Disallow /CONTENTS/
Disallow /credito
Disallow /Credito
Disallow /CREDITO
Allow /Search/Flights/AdvancedSearch
Disallow /gds-services-web/
Disallow /homes/
Disallow /Homes/
Disallow /HOMES/
Disallow /benefit-service/
Disallow /it/
Disallow /voos.html
Disallow /micrositios/
Disallow /Micrositios/
Disallow /MICROSITIOS/
Disallow /cruises/
Disallow /Cruises/
Disallow /CRUISES/
Disallow /advertising/
Disallow /Advertising/
Disallow /ADVERTISING/
Disallow /lpfrontend/
Disallow /Lpfrontend/
Disallow /LPFRONTEND/
Disallow /travelnetwork_terminos.asp
Disallow /travelnetwork_terminos_en.asp
Disallow /travelnetwork_terminos_pt.asp
Disallow /yahoo/
Disallow /Yahoo/
Disallow /YAHOO/
Disallow /yahoobr/
Disallow /Yahoobr/
Disallow /YAHOOBR/
Disallow /IpService/
Disallow /ipservice/
Disallow /IPSERVICE/
Disallow /IT/
Disallow /It/
Disallow /turismo/SiteServices/
Disallow /search/hotels/
Disallow /Hotels.Services/
Disallow /loggerjs/
Disallow /Loggerjs/
Disallow /hoteles/landinghotels/
Disallow /Hoteles/landinghotels/
Disallow /landing-hotels-web/
Disallow /cars/shop/
Disallow /Cars/shop/
Disallow /que-hacer-en-orlando/
Disallow /book/
Disallow /Book/
Disallow /BOOK/
Disallow /commercial-web/
Disallow /packages/
Disallow /PACKAGES/
Disallow /Packages/
Disallow /vuelos/handler/
Disallow /vuelos/Handler/
Disallow /vuelos/HANDLER/
Disallow /vuelos/sem/
Disallow /vuelos/Sem/
Disallow /vuelos/SEM/
Disallow /viajes_en_oferta/
Disallow /Taca/
Disallow /contactenos/
Disallow /homesv2/
Disallow /content/
Disallow /content/
Disallow /Lineas%20Aereas/
Disallow /amadeuscars/
Disallow /hoteles/search/
Disallow /hoteles/detail/
Disallow /hoteles/map/
Disallow /hoteles/ciudad/
Disallow /hoteis/cidade/
Disallow /hoteis/search/
Disallow /hoteis/detail/
Disallow /hoteis/map/
Disallow /emt-service/
Disallow /packages-static-content/
Allow /hoteles/pais/
Disallow /vuelos/detail/
Disallow /passagens-aereas/detail/
Disallow /vuelos/oneway/
Disallow /passagens-aereas/oneway/
Disallow /vuelos/roundtrip/
Disallow /passagens-aereas/roundtrip/
Disallow /accommodations/*
Disallow /trip/accommodations/*
Disallow /search/hotel/
Disallow /search/hotel/fullSearch/
Disallow /search/hotel/details/lastViewedHotels
Disallow /search/hotel/quickSearch
Disallow /search/hotel/filteredSearch
Disallow /search/hotel/details/availability/
Disallow /search/hotel/details/closestHotels/
Disallow /search/hotel/details/suggestedHotels
Disallow /search/hotel/quickSearch/
Disallow /search/hotel/summariesAndReviews/
Disallow /search/hotel/details/streetView/
Disallow /search/hotel/details/summary/
Disallow /search/hotel/details/reviews/
Disallow /Search/hotel/
Disallow /Search/hotel/fullSearch/
Disallow /Search/hotel/details/lastViewedHotels
Disallow /Search/hotel/quickSearch
Disallow /Search/hotel/filteredSearch
Disallow /Search/hotel/details/availability/
Disallow /Search/hotel/details/closestHotels/
Disallow /Search/hotel/details/suggestedHotels
Disallow /Search/hotel/quickSearch/
Disallow /Search/hotel/summariesAndReviews/
Disallow /Search/hotel/details/streetView/
Disallow /Search/hotel/details/summary/
Disallow /Search/hotel/details/reviews/
Disallow /search/Hotel/
Disallow /search/Hotel/fullSearch/
Disallow /search/Hotel/details/lastViewedHotels
Disallow /search/Hotel/quickSearch
Disallow /search/Hotel/filteredSearch
Disallow /search/Hotel/details/availability/
Disallow /search/Hotel/details/closestHotels/
Disallow /search/Hotel/details/suggestedHotels
Disallow /search/Hotel/quickSearch/
Disallow /search/Hotel/summariesAndReviews/
Disallow /search/Hotel/details/streetView/
Disallow /search/Hotel/details/summary/
Disallow /search/Hotel/details/reviews/
Disallow /Search/Hotel/
Disallow /Search/Hotel/fullSearch/
Disallow /Search/Hotel/details/lastViewedHotels
Disallow /Search/Hotel/quickSearch
Disallow /Search/Hotel/filteredSearch
Disallow /Search/Hotel/details/availability/
Disallow /Search/Hotel/details/closestHotels/
Disallow /Search/Hotel/details/suggestedHotels
Disallow /Search/Hotel/quickSearch/
Disallow /Search/Hotel/summariesAndReviews/
Disallow /Search/Hotel/details/streetView/
Disallow /Search/Hotel/details/summary/
Disallow /Search/Hotel/details/reviews/
Disallow /comunidadafiliados/resources/
Disallow /shop/flights/
Disallow /shop/flights/print/
Disallow /shop/flights/wishlist/
Disallow /shop/flights/data/
Disallow /shop/flights/results/
Disallow /cruises/shop/search/
Disallow /hoteles/h/print/
Disallow /hotels/h/print/
Disallow /hoteis/h/print/
Disallow /vacation-rentals/
Allow /paquetes/
Disallow /paquetes/sem/
Disallow /pacotes/
Disallow /pacotes/*
Disallow /packages/
Disallow /packages/*
Disallow /activities/
Disallow /activities/*
Disallow /atracoes-turisticas/
Disallow /atracoes-turisticas/*
Disallow /flights/
Disallow /flights/*
Disallow /passagens-aereas/
Disallow /passagens-aereas/*
Disallow /hotels/
Disallow /hotels/*
Disallow /hoteis/
Disallow /hoteis/*
Disallow /cars/
Disallow /cars/*
Disallow /pasajes-en-micro/shop
Disallow /passagens-de-onibus/shop
Disallow /AE_beneficios/
Disallow /beneficio_empleados/
Disallow /beneficio_topclub/
Disallow /beneficio-empleados/
Disallow /cajalosandes_beneficios/
Disallow /clubadelanteviajes/
Disallow /icbc-viajes/
Disallow /jumbomas/
Disallow /macro_premia/
Disallow /puntosbancomer/
Disallow /puntoscencosud/
Disallow /sams_beneficios/
Disallow /santanderplus/
Disallow /scotiabank_beneficios/
Disallow /superclub_canje/

adsbot-google

Rule Path
Disallow /book/
Disallow /car/shop/

baiduspider

Rule Path
Disallow /
Disallow /turismo/
Disallow /detail/hotel/services/reviews/summary/

google-hoteladsverifier

Rule Path
Disallow

*

Rule Path
Disallow /cache/
Disallow /configs/
Disallow /templates/
Disallow /util/
Disallow /vuelos/aerolineas/aerolineas-argentinas-2
Disallow /vuelos/aerolineas/latam-airlines-2
Disallow /vuelos/aerolineas/azul-linhas-aereas-2
Disallow /vuelos/aerolineas/avianca-2
Disallow /vuelos/aerolineas/gol-linhas-aereas-2
Disallow /autos/rentadoras/hertz-2
Disallow /autos/rentadoras/zr/dollar-2
Disallow /autos/rentadoras/zi/avis-2
Disallow /autos/rentadoras/al/alamo-2
Disallow /autos/rentadoras/localiza-2
Disallow /adv/
Allow /atracoes-turisticas/*/*/c-SHOW_EVENT/
Allow /actividades/*/*/c-SHOW_EVENT/
Disallow /me/
Disallow /promo-viagens/*
Disallow /promo-viajes/*
Disallow /paquetes/pais/aw/paquetes-a-aruba
Disallow /pacotes/pais/aw/pacotes-para-aruba
Disallow /cybermonday/*
Disallow /paquetes/vn2/paquetes-a-venecia
Disallow /buenfin/*
Disallow /cyberlunes/*
Disallow /black-friday/*
Disallow /tiendaclic/
Disallow /tiendaclic/*
Disallow /promocoes/*
Disallow /visitesaopaulo
Disallow /visitesaopaulo/
Disallow /visitesaopaulo/*
Disallow /ofertas-viajes/*
Allow /ofertas-viajes/semanasanta
Allow /ofertas-viajes/travelsale
Disallow /promociones/
Disallow /promociones/*
Allow /promociones-aereas/
Disallow /donde-viajar/mundo/results
Allow /ofertas-viajes/aniversario
Disallow /vuelos-multidestinos/
Disallow /vuelos-multidestinos/*
Disallow /reviews/*
Disallow /surveys/*
Disallow /survey/*
Disallow *package_id*
Allow /toure/getaways?*
Allow /toure/ch4/holidays?*
Allow /dreck/ajax/wrongcountry?*

Comments

  • Robots default
  • Los siguientes 2 son de las nuevas landings de hoteles en destinos
  • Bloquea las landings de hoteles en pais
  • Disallow: /hoteis/pais/
  • Los siguientes 3 son por la estructura de urls de mobile
  • Allow para hoteles search
  • Bloquea paginas de hoteles version para imprimir
  • Paquetes
  • Actividades
  • Vuelos
  • Hoteles
  • Autos
  • Buses
  • Special clients
  • Bloqueos especificos para el bot de QualityScore de SEM
  • Bloqueo Baidu:
  • multidestinos
  • hermes
  • desbloqueo parametros 14-09-2021
  • Disallow: /dsg/*
  • Disallow: /hermes-service/*
  • Disallow: *?