virgin-atlantic.com
robots.txt

Robots Exclusion Standard data for virgin-atlantic.com

Resource Scan

Scan Details

Site Domain virgin-atlantic.com
Base Domain virgin-atlantic.com
Scan Status Ok
Last Scan2024-10-12T21:42:07+00:00
Next Scan 2024-11-11T21:42:07+00:00

Last Scan

Scanned2024-10-12T21:42:07+00:00
URL https://virgin-atlantic.com/robots.txt
Redirect https://www.virginatlantic.com/robots.txt
Redirect Domain www.virginatlantic.com
Redirect Base virginatlantic.com
Domain IPs 3.164.85.120, 3.164.85.26, 3.164.85.36, 3.164.85.90
Redirect IPs 23.41.19.8
Response IP 184.28.52.7
Found Yes
Hash c7092e2b53a4618d8258f80fdb5ce81b8e8e18c0eece36853ace54e2ea9475fc
SimHash 663f4071e450

Groups

*

Rule Path
Disallow /home
Disallow /home/
Allow /flight-status/search
Disallow /global/
Allow /global/en/travel-information/baggage-allowance.html
Allow /global/en/destinations/usa/atlanta.html
Allow /global/en/destinations/usa.html
Allow /global/en/destinations/usa/california/san-francisco.html
Allow /global/en/destinations/usa/california/los-angeles.html
Allow /global/en/book-flights/foreign_exchange.html
Allow /global/en/flying-club/how-flying-club-works/help-logging-in.html
Allow /global/en/destinations/usa/california/los-angeles.html
Allow /global/en/destinations/usa/boston.html
Allow /global/en/destinations/usa/california/san-francisco.html
Allow /global/en/travel-information/ways-to-check-in.html
Allow /global/en/destinations/route-map.html
Allow /global/en/sustainability.html
Disallow /prefillapp/dwr/call/plaincall/prefill.retrievePrefillData.dwr
Disallow /utils/dwr/call/plaincall/AirportLookupDWR.getAirportLookupFrame.dwr
Disallow /utils/dwr/call/plaincall/CountryDetailsProcessor.getCountryLangList.dwr
Disallow /dlhome/shared/components/TealeafTarget.jsp
Disallow /air-shopping/searchFlights.action?action=
Disallow /air-shopping/flexDates.action
Disallow /dlsearch/
Disallow *cacheKey*
Disallow *reference_components*
Disallow /gb/en/flight-deals/flights-to-london-from-au-nz.html
Disallow /gb/en/depart-the-everyday-email.html
Disallow /gb/en/flight-deals/flights-to-london-from-tlv.html
Disallow /gb/en/flight-deals-new.html
Disallow /gb/en/5-reasons.html
Disallow /global/en/flying-club/boarding-card-qr.html
Disallow /br/en/flying-club/boarding-card-qr.html
Disallow /gb/en/flying-club/boarding-card-qr.html
Disallow /us/en/flying-club/boarding-card-qr.html
Disallow /za/en/flying-club/boarding-card-qr.html
Disallow /in/en/flying-club/boarding-card-qr.html
Disallow /ng/en/flying-club/boarding-card-qr.html
Disallow /bb/en/flying-club/boarding-card-qr.html
Disallow /eu/en/flying-club/boarding-card-qr.html
Disallow /cn/en/flying-club/boarding-card-qr.html
Disallow /hk/en/flying-club/boarding-card-qr.html
Disallow /global/en/flying-club/onboard-enrollment-qr.html
Disallow /br/en/flying-club/onboard-enrollment-qr.html
Disallow /gb/en/flying-club/onboard-enrollment-qr.html
Disallow /us/en/flying-club/onboard-enrollment-qr.html
Disallow /za/en/flying-club/onboard-enrollment-qr.html
Disallow /in/en/flying-club/onboard-enrollment-qr.html
Disallow /ng/en/flying-club/onboard-enrollment-qr.html
Disallow /bb/en/flying-club/onboard-enrollment-qr.html
Disallow /eu/en/flying-club/onboard-enrollment-qr.html
Disallow /cn/en/flying-club/onboard-enrollment-qr.html
Disallow /hk/en/flying-club/onboard-enrollment-qr.html
Disallow /global/en/flying-club/vera_qr.html
Disallow /br/en/flying-club/vera_qr.html
Disallow /gb/en/flying-club/vera_qr.html
Disallow /us/en/flying-club/vera_qr.html
Disallow /za/en/flying-club/vera_qr.html
Disallow /in/en/flying-club/vera_qr.html
Disallow /ng/en/flying-club/vera_qr.html
Disallow /bb/en/flying-club/vera_qr.html
Disallow /eu/en/flying-club/vera_qr.html
Disallow /cn/en/flying-club/vera_qr.html
Disallow /hk/en/flying-club/vera_qr.html
Disallow /global/en/flying-club/onboard-video.html
Disallow /br/en/flying-club/onboard-video.html
Disallow /gb/en/flying-club/onboard-video.html
Disallow /us/en/flying-club/onboard-video.html
Disallow /za/en/flying-club/onboard-video.html
Disallow /in/en/flying-club/onboard-video.html
Disallow /ng/en/flying-club/onboard-video.html
Disallow /bb/en/flying-club/onboard-video.html
Disallow /eu/en/flying-club/onboard-video.html
Disallow /cn/en/flying-club/onboard-video.html
Disallow /hk/en/flying-club/onboard-video.html

Other Records

Field Value
sitemap https://www.virginatlantic.com/sitemap.xml

Comments

  • Block appended home
  • Index flight status
  • Block access to /global/ URLs
  • The internal links to /content/vaa/ need to be updated.
  • Block Googlebot POST requests
  • Block Tealeaf
  • Block Flight search results, not flight search.
  • Block Site Search URLs
  • Sitemap Reference
  • cacheKeysuffix URLs being crawled