costcotravel.com
robots.txt

Robots Exclusion Standard data for costcotravel.com

Resource Scan

Scan Details

Site Domain costcotravel.com
Base Domain costcotravel.com
Scan Status Ok
Last Scan2024-06-07T20:32:58+00:00
Next Scan 2024-07-07T20:32:58+00:00

Last Scan

Scanned2024-06-07T20:32:58+00:00
URL https://costcotravel.com/robots.txt
Redirect https://www.costcotravel.com/robots.txt
Redirect Domain www.costcotravel.com
Redirect Base costcotravel.com
Domain IPs 184.85.118.145
Redirect IPs 104.69.168.183
Response IP 104.69.47.249
Found Yes
Hash 85a3be5c7cdf074003773dc240a99eaedf95fa2da7be36b1a1a5d56943de03ff
SimHash e9c4cbec0204

Groups

*

Rule Path
Disallow /blank.html
Disallow /blank.jsp
Disallow /booking.act
Disallow /cruiseBooking.act
Disallow /legacy/cruiseBooking.act
Disallow /carBooking.act
Disallow /menuContent.act
Disallow /js.act
Disallow /shared/css/
Disallow /shared/js/
Disallow /shared/swf/
Disallow /shared/xml/
Disallow /shared/info/
Disallow /package/
Disallow /cr/
Disallow /rc/
Disallow /vp/
Disallow /booking/

ninjabot

Rule Path
Allow /

Comments

  • robots.txt for http://www.costcotravel.com - Updated: 01/04/2013
  • Sitemap: http://www.costcotravel.com/sitemaps/sitemap.xml