costcotravel.ca
robots.txt

Robots Exclusion Standard data for costcotravel.ca

Resource Scan

Scan Details

Site Domain costcotravel.ca
Base Domain costcotravel.ca
Scan Status Ok
Last Scan2024-09-26T05:57:56+00:00
Next Scan 2024-10-26T05:57:56+00:00

Last Scan

Scanned2024-09-26T05:57:56+00:00
URL https://costcotravel.ca/robots.txt
Redirect https://www.costcotravel.ca/robots.txt
Redirect Domain www.costcotravel.ca
Redirect Base costcotravel.ca
Domain IPs 118.215.83.148
Redirect IPs 118.215.83.148
Response IP 23.77.5.112
Found Yes
Hash 85a3be5c7cdf074003773dc240a99eaedf95fa2da7be36b1a1a5d56943de03ff
SimHash e9c4cbec0204

Groups

*

Rule Path
Disallow /blank.html
Disallow /blank.jsp
Disallow /booking.act
Disallow /cruiseBooking.act
Disallow /legacy/cruiseBooking.act
Disallow /carBooking.act
Disallow /menuContent.act
Disallow /js.act
Disallow /shared/css/
Disallow /shared/js/
Disallow /shared/swf/
Disallow /shared/xml/
Disallow /shared/info/
Disallow /package/
Disallow /cr/
Disallow /rc/
Disallow /vp/
Disallow /booking/

ninjabot

Rule Path
Allow /

Comments

  • robots.txt for http://www.costcotravel.com - Updated: 01/04/2013
  • Sitemap: http://www.costcotravel.com/sitemaps/sitemap.xml