virginatlantic.com
robots.txt

Robots Exclusion Standard data for virginatlantic.com

Resource Scan

Scan Details

Site Domain virginatlantic.com
Base Domain virginatlantic.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-11T08:24:02+00:00
Next Scan 2024-10-10T08:24:02+00:00

Last Successful Scan

Scanned2024-05-21T08:20:52+00:00
URL https://virginatlantic.com/robots.txt
Redirect https://www.virginatlantic.com/robots.txt
Redirect Domain www.virginatlantic.com
Redirect Base virginatlantic.com
Domain IPs 99.84.203.108, 99.84.203.22, 99.84.203.50, 99.84.203.66
Redirect IPs 184.28.52.7
Response IP 184.28.52.7
Found Yes
Hash f9203bd62084bc808fabd6052f436bf30c8e05afca93e4134bdfafc903b7b2b1
SimHash 663f5073f440

Groups

*

Rule Path
Allow /flight-status/search
Disallow /global/
Allow /global/en/travel-information/baggage-allowance.html
Allow /global/en/destinations/usa/atlanta.html
Allow /global/en/destinations/usa.html
Allow /global/en/destinations/usa/california/san-francisco.html
Allow /global/en/destinations/usa/california/los-angeles.html
Allow /global/en/book-flights/foreign_exchange.html
Allow /global/en/flying-club/how-flying-club-works/help-logging-in.html
Allow /global/en/destinations/usa/california/los-angeles.html
Allow /global/en/destinations/usa/boston.html
Allow /global/en/destinations/usa/california/san-francisco.html
Allow /global/en/travel-information/ways-to-check-in.html
Allow /global/en/destinations/route-map.html
Allow /global/en/sustainability.html
Disallow /prefillapp/dwr/call/plaincall/prefill.retrievePrefillData.dwr
Disallow /utils/dwr/call/plaincall/AirportLookupDWR.getAirportLookupFrame.dwr
Disallow /utils/dwr/call/plaincall/CountryDetailsProcessor.getCountryLangList.dwr
Disallow /dlhome/shared/components/TealeafTarget.jsp
Disallow /air-shopping/searchFlights.action?action=
Disallow /air-shopping/flexDates.action
Disallow /dlsearch/
Disallow *cacheKey*
Disallow *reference_components*
Disallow /gb/en/flight-deals/flights-to-london-from-au-nz.html
Disallow /gb/en/depart-the-everyday-email.html
Disallow /gb/en/flight-deals/flights-to-london-from-tlv.html
Disallow /gb/en/flight-deals-new.html
Disallow /gb/en/5-reasons.html
Disallow /global/en/flying-club/boarding-card-qr.html
Disallow /br/en/flying-club/boarding-card-qr.html
Disallow /gb/en/flying-club/boarding-card-qr.html
Disallow /us/en/flying-club/boarding-card-qr.html
Disallow /za/en/flying-club/boarding-card-qr.html
Disallow /in/en/flying-club/boarding-card-qr.html
Disallow /ng/en/flying-club/boarding-card-qr.html
Disallow /bb/en/flying-club/boarding-card-qr.html
Disallow /eu/en/flying-club/boarding-card-qr.html
Disallow /cn/en/flying-club/boarding-card-qr.html
Disallow /hk/en/flying-club/boarding-card-qr.html
Disallow /global/en/flying-club/onboard-enrollment-qr.html
Disallow /br/en/flying-club/onboard-enrollment-qr.html
Disallow /gb/en/flying-club/onboard-enrollment-qr.html
Disallow /us/en/flying-club/onboard-enrollment-qr.html
Disallow /za/en/flying-club/onboard-enrollment-qr.html
Disallow /in/en/flying-club/onboard-enrollment-qr.html
Disallow /ng/en/flying-club/onboard-enrollment-qr.html
Disallow /bb/en/flying-club/onboard-enrollment-qr.html
Disallow /eu/en/flying-club/onboard-enrollment-qr.html
Disallow /cn/en/flying-club/onboard-enrollment-qr.html
Disallow /hk/en/flying-club/onboard-enrollment-qr.html
Disallow /global/en/flying-club/vera_qr.html
Disallow /br/en/flying-club/vera_qr.html
Disallow /gb/en/flying-club/vera_qr.html
Disallow /us/en/flying-club/vera_qr.html
Disallow /za/en/flying-club/vera_qr.html
Disallow /in/en/flying-club/vera_qr.html
Disallow /ng/en/flying-club/vera_qr.html
Disallow /bb/en/flying-club/vera_qr.html
Disallow /eu/en/flying-club/vera_qr.html
Disallow /cn/en/flying-club/vera_qr.html
Disallow /hk/en/flying-club/vera_qr.html
Disallow /global/en/flying-club/onboard-video.html
Disallow /br/en/flying-club/onboard-video.html
Disallow /gb/en/flying-club/onboard-video.html
Disallow /us/en/flying-club/onboard-video.html
Disallow /za/en/flying-club/onboard-video.html
Disallow /in/en/flying-club/onboard-video.html
Disallow /ng/en/flying-club/onboard-video.html
Disallow /bb/en/flying-club/onboard-video.html
Disallow /eu/en/flying-club/onboard-video.html
Disallow /cn/en/flying-club/onboard-video.html
Disallow /hk/en/flying-club/onboard-video.html

Other Records

Field Value
sitemap https://www.virginatlantic.com/sitemap.xml

Comments

  • Index flight status
  • Block access to /global/ URLs
  • The internal links to /content/vaa/ need to be updated.
  • Block Googlebot POST requests
  • Block Tealeaf
  • Block Flight search results, not flight search.
  • Block Site Search URLs
  • Sitemap Reference
  • cacheKeysuffix URLs being crawled