cruisewatchdog.com
robots.txt
Robots Exclusion Standard data for cruisewatchdog.com
Resource Scan
Scan Details
| Site Domain | cruisewatchdog.com |
| Base Domain | cruisewatchdog.com |
| Scan Status | Ok |
| Last Scan | 2024-10-30T23:37:13+00:00 |
| Next Scan | 2024-11-29T23:37:13+00:00 |
Last Scan
| Scanned | 2024-10-30T23:37:13+00:00 |
| URL | https://cruisewatchdog.com/robots.txt |
| Redirect | https://www.cruisecritic.com/robots.txt |
| Redirect Domain | www.cruisecritic.com |
| Redirect Base | cruisecritic.com |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.61, 76.76.21.98 |
| Response IP | 76.76.21.241 |
| Found | Yes |
| Hash | e89a7702402a8b568c716fb8d5815f424e20a3bb5439bf8d27b64614bc6ca465 |
| SimHash | 380854823f56 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /activedit | - |
| Disallow | /ab/ | - |
| Disallow | /afs | - |
| Disallow | /apps | - |
| Disallow | /bargains/news_print.cfm | - |
| Disallow | /bargains/xml-wide.cfm | - |
| Disallow | /campaign/ | - |
| Disallow | /ccadm | - |
| Disallow | /cruiseto/cruiseitineraries/ | - |
| Disallow | /doubleclick | - |
| Disallow | /feeds | - |
| Disallow | /memberreviews/memberpoll_index_print.cfm | - |
| Disallow | /memberreviews/memberreview_print.cfm | - |
| Disallow | /memberreviews/cruiserschoice_rules.cfm | - |
| Disallow | /news/news_print.cfm | - |
| Disallow | /news/script.txt | - |
| Disallow | /news/scroller.cfm | - |
| Disallow | /poll | - |
| Disallow | /polls/cookie.cfm | - |
| Disallow | /polls/index.cfm | - |
| Disallow | /polls/testwidget2.cfm | - |
| Disallow | /polls/testwidget3.cfm | - |
| Disallow | /polls/testwidget.cfm | - |
| Disallow | /ports/article_print.cfm | - |
| Disallow | /ports/directions_print.cfm | - |
| Disallow | /ports/minibreak_print.cfm | - |
| Disallow | /ports/newport_print.cfm | - |
| Disallow | /quizzes | - |
| Disallow | /reviews/cruiseline_print.cfm | - |
| Disallow | /reviews/review_print.cfm | - |
| Disallow | /rollcall/entry_cl.cfm | - |
| Disallow | /rollcall/partylist.cfm | - |
| Disallow | /rollcall/shipdropdown.cfm | - |
| Disallow | /rollcall/shipdropdown_boards.cfm | - |
| Disallow | /rollcall/shipdropdown_entry.cfm | - |
| Disallow | /rollcall/thank-you | - |
| Disallow | /search | - |
| Disallow | /vbulletin | - |
| Disallow | /virtual/virtual_print.cfm | - |
| Disallow | /wip/* | - |
| Disallow | /work_data | - |
| Disallow | /v-*/* | - |
| Disallow | /smart-deals | - |
| Disallow | /hipship/ | - |
| Disallow | /static/manage-subscriptions/ | - |
| Disallow | /*sort%26 | x3D;* |
| Disallow | /*/dp/*deck%26 | x3D;* |
| Disallow | /helpers/ | - |
| Disallow | /sail-away | - |
| Disallow | /storyblok/* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cruisecritic.com/sitemaps/index.xml |
Comments