skyscanner.com
robots.txt

Robots Exclusion Standard data for skyscanner.com

Resource Scan

Scan Details

Site Domain skyscanner.com
Base Domain skyscanner.com
Scan Status Ok
Last Scan2024-11-13T12:27:30+00:00
Next Scan 2024-11-20T12:27:30+00:00

Last Scan

Scanned2024-11-13T12:27:30+00:00
URL https://skyscanner.com/robots.txt
Redirect https://www.skyscanner.com/robots.txt
Redirect Domain www.skyscanner.com
Redirect Base skyscanner.com
Domain IPs 13.248.155.102, 76.223.21.241
Redirect IPs 3.165.82.122, 3.165.82.123, 3.165.82.20, 3.165.82.86
Response IP 3.165.82.20
Found Yes
Hash d0ab83fa415879f0175cc438fcd6a43a2462d175f32665bff151b302932d9964
SimHash 1327903ec037

Groups

mediapartners-google

Rule Path
Disallow /deeplink*
Disallow /transport_deeplink*
Disallow /doprava/*
Disallow /liikennevalineet/*
Disallow /pengangkutan/*
Disallow /sasakyan/*
Disallow /tasima/*
Disallow /transport/*
Disallow /transportasi/*
Disallow /transporte/*
Disallow /trasporti/*

shopwiki

Rule Path
Disallow /

npbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

henrythemiragorobot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

appie

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*
ahrefsbot

Rule Path
Disallow /*/Undefined/
Disallow /*/browse-view/
Disallow /*/day-view-1/
Disallow /*/day-view-b/
Disallow /*/day-view-p/
Disallow /*/day-view/
Disallow /*/hotels-homepage/
Disallow /*/landing_
Disallow /*/link_
Disallow /*/month-view/
Disallow /*/year-view/
Disallow /*/*?p1=
Disallow /*/*%26p1%3D
Disallow /*/*?p2=
Disallow /*/*%26p2%3D
Disallow /*/*?p3=
Disallow /*/*%26p3%3D
Disallow /*/*?p4=
Disallow /*/*%26p4%3D
Disallow /*/selected-flights.html
Disallow /*/worldwide.html
Disallow /prices-calendar
Disallow *.rss*
Disallow /sc.ashx*
Disallow /as.ashx*
Disallow /map.ashx*
Disallow *?dbg*
Disallow *%26dbg*
Disallow *?debug*
Disallow *%26debug*
Disallow /deeplink*
Disallow /transport_deeplink*
Disallow /prijevoz/*
Disallow /preprava/*
Disallow /dataservices/*
Disallow /sem/*
Disallow /skippy_api/*
Disallow /airport_transfer_deeplink/*
Disallow /g/*
Allow /g/banana/api/context
Disallow /tallyman/context
Disallow /*/as-passagens-aereas-promocionais-*
Disallow /*/billigaste-flyg-*
Disallow /*/billigste-avganger-*
Disallow /*/billigste-fly-*
Disallow /*/cele-mai-ieftine-zboruri-*
Disallow /*/cheapest-flights-*
Disallow /*/die-billigsten-fluge-*
Disallow /*/en_ucuz_ucuslar-*
Disallow /*/goedkoopste-vluchten-*
Disallow /*/halvimmat-lennot-*
Disallow /*/legolcsobb-repulojegyek-*
Disallow /*/mga-pinakamurang-byahe-*
Disallow /*/najtansze-loty-*
Disallow /*/nejlevnejsi_lety-*
Disallow /*/os-voos-mais-baratos-*
Disallow /*/penerbangan-termurah-*
Disallow /*/voli-piu-economici-*
Disallow /*/vols-les-moins-chers-*
Disallow /*/vuelos-mas-baratos-*
Disallow /*/vuelos-mas-economicos-*
Disallow /*/airfares-*
Disallow /*/bilete-de-avion-*
Disallow /*/biljettpriser-*
Disallow /*/billettpriser-*
Disallow /*/ceny-biletow-lotniczych-*
Disallow /*/ceny-letu-*
Disallow /*/cuoc-hang-khong-*
Disallow /*/flugpreise-*
Disallow /*/flybilletpriser-*
Disallow /*/jegyarak-*
Disallow /*/lentolippujen-hinnat-*
Disallow /*/mga-pasahe-*
Disallow /*/ongkos-penerbangan-*
Disallow /*/tambang-penerbangan-*
Disallow /*/tarifas-*
Disallow /*/tarifas-aereas-*
Disallow /*/tariffe-aeree-*
Disallow /*/tarifs-*
Disallow /*/ucus_ucretleri-*
Disallow /*/vliegtarieven-*
Disallow /doprava/*
Disallow /liikennevalineet/*
Disallow /pengangkutan/*
Disallow /sasakyan/*
Disallow /tasima/*
Disallow /transport/*
Disallow /transportasi/*
Disallow /transporte/*
Disallow /trasporti/*
Disallow /hotel_deeplink*
Disallow /hotels/q?*
Disallow /hotels/q/*
Disallow /hotels/hotel/*
Disallow /hotels/frontend/*
Disallow /hotels/book/*
Disallow /hotels/search*
Disallow /carhire_deeplink*
Disallow /carhire-landing/*
Disallow /SearchResults.aspx$
Disallow /carhire/static/*
Disallow /carhire-homepage/*
Disallow /alquiler-de-coches/resultados/*
Disallow /aluguel-de-carros/resultados/*
Disallow /aluguer-de-automoveis/resultados/*
Disallow /araba-kiralama/sonuclar/*
Disallow /arac-kiralama/sonuclar/*
Disallow /autoberles/eredmenyek/*
Disallow /autokolcsonzes/eredmenyek/*
Disallow /autonoleggio/risultati/*
Disallow /autonvuokraus/tulosta/*
Disallow /autoverhuur/resultaten/*
Disallow /billeje/resultater/*
Disallow /biludlejning/resultater/*
Disallow /biluthyrning/resultat/*
Disallow /bilutleie/resultater/*
Disallow /car-hire/resultados/*
Disallow /car-hire/results/*
Disallow /car-rental/results/*
Disallow /carhire/results/*
Disallow /hyrbil/resultat/*
Disallow /inchiriere-auto/rezultate/*
Disallow /inchirieri-auto/rezultate/*
Disallow /kereta-sewa/hasil/*
Disallow /location-de-voiture/resultats/*
Disallow /location-voiture/resultats/*
Disallow /maaarkilang-sasakyan/mga-resulta/*
Disallow /mietwagen/ergebnisse/*
Disallow /noleggio-auto/risultati/*
Disallow /pag-aarkila-ng-kotse/mga-resulta/*
Disallow /pronajem-auta/vysledky/*
Disallow /pujceni-auta/vysledky/*
Disallow /renta-de-autos/resultados/*
Disallow /sewa-mobil/hasil/*
Disallow /thue-xe/ket-qua/*
Disallow /wynajem-samochodow/wyniki/*
Disallow /24268069/*
Disallow /inspiration/*
Disallow /book/*
Disallow /fab/*
Disallow /landing_*
Disallow /itineraires/*/itineraires-de-*
Disallow /itineraires/*/routes-a-partir-de-*
Disallow /laluan/*/laluan-dari-*
Disallow /mga-ruta/*/mga-ruta-mula-sa-*
Disallow /reitit/*/lentoreitit-*
Disallow /reitit/*/reitit-mista-*
Disallow /rotalar/*/rotalar-kalkis-*
Disallow /rotalar/*/suradan-rotalar-*
Disallow /rotas/*/rotas-de-*
Disallow /rotte/*/rotte-da-*
Disallow /routen/*/routen-ab-*
Disallow /routen/*/routen-von-*
Disallow /routes/*/cac-duong-bay-tu-*
Disallow /routes/*/routes-from-*
Disallow /routes/*/routes-van-*
Disallow /routes/*/routes-vanaf-*
Disallow /rutas-aereas/*/rutas-aereas-de-*
Disallow /rutas-aereas/*/rutas-de-*
Disallow /rutas/*/rutas-de-*
Disallow /rute/*/rute-dari-*
Disallow /rute/*/rute-de-la-*
Disallow /rute/*/rute-din-*
Disallow /ruter/*/flyreiser-fra-*
Disallow /ruter/*/ruter-fra-*
Disallow /rutter/*/rutter-fran-*
Disallow /rutter/*/turer-fran-*
Disallow /trasy/*/loty-z-*
Disallow /trasy/*/trasy-od-*
Disallow /trasy/*/trasy-z-*
Disallow /utvonalak/*/utvonalak-indulas-*
Disallow /trip/abuse_reports/
Disallow /trip/redirect
Disallow /trip/questions/form
Disallow /trip/input/
Disallow /trip/regions/random
Disallow /trip/trips/
Disallow /trip/user_sessions/
Disallow /trip/password_resets/
Disallow /trip/users/new
Disallow /trip/users/follow
Disallow /trip/filters/
Disallow /trip/questions/note_form
Disallow /trip/user_likes/
Disallow /trip/api/
Disallow /trip/mapp/
Disallow /trip/items_medias/delete/
Disallow /trip/*/place_overlay/
Disallow /trip/users/dismiss_user_place/
Disallow /trip/*/journal_moment_overlay/
Disallow /trip/relations/
Disallow /trip/tracking/
Disallow /trip/hotels/
Disallow /trip/user/
Disallow /trip/user/*/passport/
Disallow /trip/user/*/badge/
Disallow /trip/user/*/place/
Disallow /trip/user/*/stamps
Disallow /trip/user/*/stamp/
Disallow /trip/map_widget/new
Disallow /trip/edit_info/
Disallow /trip/moderation/
Disallow /trip/info_submit/
Disallow /trip/topics/
Disallow /trip/graph/
Disallow /trip/booking_form
Disallow /trip/medias/upload_form
Disallow /trip/mturk-fb
Disallow /trip/*--mini_map
Disallow /trip/*--description_modal
Disallow /trip/*--weekly_recs
Disallow /trip/*--pois_by_tribes
Disallow /trip/*--get_widget
Disallow /trip/*/mini-map
Disallow /trip/*/pois-by-tribes
Disallow /trip/*/get-widget
Disallow /trip/*/license.e.swf
Disallow /origin-selector*
Disallow /destination-selector*
Disallow /date-picker*
Disallow /cabin-travellers-picker*
Disallow /package-holidays*
Disallow /slipstream/
Disallow /rf8vapwA/xhr/

Other Records

Field Value
sitemap https://www.skyscanner.com/sitemap.xml

Warnings

  • 1 invalid line.