costcotravel.com
robots.txt
Robots Exclusion Standard data for costcotravel.com
Resource Scan
Scan Details
Site Domain | costcotravel.com |
Base Domain | costcotravel.com |
Scan Status | Ok |
Last Scan | 2024-06-07T20:32:58+00:00 |
Next Scan | 2024-07-07T20:32:58+00:00 |
Last Scan
Scanned | 2024-06-07T20:32:58+00:00 |
URL | https://costcotravel.com/robots.txt |
Redirect | https://www.costcotravel.com/robots.txt |
Redirect Domain | www.costcotravel.com |
Redirect Base | costcotravel.com |
Domain IPs | 184.85.118.145 |
Redirect IPs | 104.69.168.183 |
Response IP | 104.69.47.249 |
Found | Yes |
Hash | 85a3be5c7cdf074003773dc240a99eaedf95fa2da7be36b1a1a5d56943de03ff |
SimHash | e9c4cbec0204 |
Groups
*
Rule | Path |
---|---|
Disallow | /blank.html |
Disallow | /blank.jsp |
Disallow | /booking.act |
Disallow | /cruiseBooking.act |
Disallow | /legacy/cruiseBooking.act |
Disallow | /carBooking.act |
Disallow | /menuContent.act |
Disallow | /js.act |
Disallow | /shared/css/ |
Disallow | /shared/js/ |
Disallow | /shared/swf/ |
Disallow | /shared/xml/ |
Disallow | /shared/info/ |
Disallow | /package/ |
Disallow | /cr/ |
Disallow | /rc/ |
Disallow | /vp/ |
Disallow | /booking/ |
Comments