disneycruiselatino.com
robots.txt

Robots Exclusion Standard data for disneycruiselatino.com

Resource Scan

Scan Details

Site Domain disneycruiselatino.com
Base Domain disneycruiselatino.com
Scan Status Ok
Last Scan2024-05-03T04:05:56+00:00
Next Scan 2024-06-02T04:05:56+00:00

Last Scan

Scanned2024-05-03T04:05:56+00:00
URL https://disneycruiselatino.com/robots.txt
Redirect https://disneycruise.disney.go.com/robots.txt
Redirect Domain disneycruise.disney.go.com
Redirect Base go.com
Domain IPs 2600:1901:0:84f4::80, 34.110.155.89
Redirect IPs 23.203.72.75
Response IP 23.15.97.74
Found Yes
Hash 58943fb9e5c0a50c6d4c970a2d08049182444fc8949d967c336ce0c21a29c2c5
SimHash 501c4952c813

Groups

*

Rule Path
Disallow /dcl/en_US/_lib/
Disallow /dcl/_global/modules/
Disallow /dcl/_lib/
Disallow /dcl/system/
Disallow /dcl/myCruise/myProfile/system/
Disallow /dcl/myCruise/myProfile/validate/
Disallow /dcl/myCruise/castawayClub/controller/
Disallow /dcl/myCruise/castawayClub/modules/
Disallow /dcl/myCruise/castawayClub/tools/
Disallow /en_US/_lib/
Disallow /_lib/
Disallow /cart/
Disallow /search/
Disallow /search-results/
Disallow /select-stateroom/
Disallow /reservations/
Disallow /planning-center/my-cruise-plans/*

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://disneycruise.disney.go.com/sitemap.xml

Comments

  • Disney Cruise Line Excludes
  • Directory Excludes
  • Disallow directives for AI web crawlers
  • Announce Sitemap Locations