cruise.rci.com
robots.txt

Robots Exclusion Standard data for cruise.rci.com

Resource Scan

Scan Details

Site Domain cruise.rci.com
Base Domain rci.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-22T08:12:46+00:00
Next Scan 2025-10-22T08:12:46+00:00

Last Successful Scan

Scanned2025-08-01T07:30:32+00:00
URL https://cruise.rci.com/robots.txt
Domain IPs 45.60.123.26
Response IP 45.60.123.26
Found Yes
Hash 1adb81c736d652a120dc42497179b5dcfeeec9a610836bb1f7d27202db49e3bf
SimHash 6410775bf319

Groups

*

Rule Path
Allow /includes/*.css
Allow /includes/css/
Allow /includes/adtiles/
Allow /includes/desktop/
Allow /includes/mobile/
Allow /includes/sitemap/
Allow /includes/*.js$
Allow /images_unique/
Allow /code/*.xml$
Allow /code/*.js$
Disallow /invoiceredirect.do
Disallow /invoice.do
Disallow /b21/c
Disallow /b23/c
Disallow /b/c
Disallow /B/C
Disallow /b/v
Disallow /B/V
Disallow /aa_fall_sale/
Disallow /bookit/
Disallow /code/
Disallow /Compare/
Disallow /compare/
Disallow /contact/
Disallow /databahn2/
Disallow /dbbookingengine/
Disallow /dbSSL/
Disallow /dbssl/
Disallow /disney/
Disallow /EXOTIC/
Disallow /hawaii/
Disallow /includes/
Disallow /login/
Disallow /mobile/
Disallow /MyChoices/
Disallow /mychoices/
Disallow /results.do
Disallow /redcross/
Disallow /sale/
Disallow /SbBookingEngine/
Disallow /sbbookingengine/
Disallow /SbSSL/
Disallow /sbssl/
Disallow /t/
Disallow /ti/
Disallow /TISSL/
Disallow /tissl/
Disallow /villa/
Disallow /villa-destination/
Disallow /villa-location/
Disallow /Villa.do/
Disallow /invoiceredirect.do
Disallow /bcss/
Disallow /Bcss/
Disallow /BCSS/
Disallow /s/
Disallow /b/v/
Disallow /lib/error/smart404.asp
Disallow /reviews/
Disallow /cs/
Disallow /images/ajax-loader.gif
Disallow /images/category_legends/
Disallow /images/crulogos/
Disallow /images/deckplans/
Disallow /images/floor_layout/
Disallow /images/floorplans/
Disallow /images/lifestyle/
Disallow /images/public/
Disallow /images/ship_ext/
Disallow /images/symbol_key/
Disallow /images/xsec/
Disallow /images_unique/b.gif
Disallow /images_unique/blank.gif
Disallow /images_unique/cr/
Disallow /images_unique/cruisesonly/header-resp/
Disallow /images_unique/cruonly/
Disallow /images_unique/icon_anchor_down.gif
Disallow /images_unique/icon_anchor_up.gif
Disallow /images_unique/java/
Disallow /magnoliaAuthor/
Disallow /interstitial.do
Disallow /sharedwidgets/
Disallow /lightbox/
Disallow /log/
Disallow /idle.do
Disallow /mailing.do

googlebot-image

Rule Path
Disallow

googlebot

Rule Path
Disallow

oai-searchbot

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow

gptbot

Rule Path
Disallow

anthropic-ai

Rule Path
Disallow

claudebot

Rule Path
Disallow

google-extended

Rule Path
Disallow

applebot

Rule Path
Disallow

applebot-extended

Rule Path
Disallow

bingbot

Rule Path
Disallow

facebookbot

Rule Path
Disallow

perplexitybot

Rule Path
Disallow

youbot

Rule Path
Disallow

duckassistbot

Rule Path
Disallow

jakarta commons-httpclient

Rule Path
Disallow

applewebkit

Rule Path
Disallow

amazonbot

Rule Path
Disallow

bytespider

Rule Path
Disallow

claude-web

Rule Path
Disallow

dotbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

Comments

  • robot exclusion list

Warnings

  • 2 invalid lines.
  • `request-rate` is not a known field.