flightcentre.ca
robots.txt

Robots Exclusion Standard data for flightcentre.ca

Resource Scan

Scan Details

Site Domain flightcentre.ca
Base Domain flightcentre.ca
Scan Status Ok
Last Scan2024-05-21T02:43:19+00:00
Next Scan 2024-06-20T02:43:19+00:00

Last Scan

Scanned2024-05-21T02:43:19+00:00
URL https://flightcentre.ca/robots.txt
Redirect https://www.flightcentre.ca/robots.txt
Redirect Domain www.flightcentre.ca
Redirect Base flightcentre.ca
Domain IPs 209.15.37.6
Redirect IPs 13.33.88.103, 13.33.88.81, 13.33.88.94, 13.33.88.98, 2600:9000:223b:1a00:15:967a:7b00:93a1, 2600:9000:223b:6200:15:967a:7b00:93a1, 2600:9000:223b:6800:15:967a:7b00:93a1, 2600:9000:223b:a200:15:967a:7b00:93a1, 2600:9000:223b:a800:15:967a:7b00:93a1, 2600:9000:223b:c200:15:967a:7b00:93a1, 2600:9000:223b:de00:15:967a:7b00:93a1, 2600:9000:223b:e400:15:967a:7b00:93a1
Response IP 13.33.88.103
Found Yes
Hash 4a49dc68c5da953deeec6ef53f4c52d519ef8472acb6bf4473ca99a28e80d069
SimHash 8c5053c14bd5

Groups

*

Rule Path
Disallow /hotels/booking/
Disallow /bookingengine/
Disallow /vacations/sun-packages/booking/
Disallow /flights/booking/
Disallow /search/
Disallow /_bookings
Disallow /3rdparty
Disallow /error.jsp
Disallow /_cruise/
Disallow /agents/
Disallow /profiles/
Disallow /includes/
Disallow /3rdparty/
Disallow /TMP
Disallow /_
Disallow /hotels/admin/
Disallow /FCKeditor/
Disallow /hotels/admin/
Disallow /hotels/locator/admin/
Disallow /SF.com/
Disallow /WEB-INF/
Disallow /_unbeatable/
Disallow /cgi-bin/
Disallow /en-CA/
Disallow /_email-stats/
Disallow /_bookings/
Disallow /blog/wp-content/plugins/
Disallow /blog/wp-admin/
Disallow /blog/wp-includes/
Disallow /flipboard/

Other Records

Field Value
sitemap https://www.flightcentre.ca/sitemap.xml
sitemap https://www.flightcentre.ca/aurora/api/sitemap/en-CA/content-sitemap.xml?types=blog_post,rich_page,blogs_landing,flights_landing,flights_destination,flights_p2p,holidays_landing,holidays_destination,holidays_type,travel_guide_page,cruises_landing,cruises_destination,cruises_departing_from,cruise_line,cruise_ship