cruisecritic.com.au
robots.txt
Robots Exclusion Standard data for cruisecritic.com.au
Resource Scan
Scan Details
| Site Domain | cruisecritic.com.au |
| Base Domain | cruisecritic.com.au |
| Scan Status | Ok |
| Last Scan | 2024-06-29T03:35:34+00:00 |
| Next Scan | 2024-07-06T03:35:34+00:00 |
Last Scan
| Scanned | 2024-06-29T03:35:34+00:00 |
| URL | https://cruisecritic.com.au/robots.txt |
| Redirect | https://www.cruisecritic.com.au/robots.txt |
| Redirect Domain | www.cruisecritic.com.au |
| Redirect Base | cruisecritic.com.au |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.21 |
| Response IP | 76.76.21.21 |
| Found | Yes |
| Hash | 110b64e54629fa42cdfa80d8a26600aa36d318037665a6d748d16fc6a6e86a05 |
| SimHash | b8080cc25f56 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /activedit | - |
| Disallow | /ab/ | - |
| Disallow | /afs | - |
| Disallow | /apps | - |
| Disallow | /bargains/news_print.cfm | - |
| Disallow | /bargains/xml-wide.cfm | - |
| Disallow | /campaign/ | - |
| Disallow | /ccadm | - |
| Disallow | /cruiseto/cruiseitineraries/ | - |
| Disallow | /doubleclick | - |
| Disallow | /feeds | - |
| Disallow | /memberreviews/memberpoll_index_print.cfm | - |
| Disallow | /memberreviews/memberreview_print.cfm | - |
| Disallow | /memberreviews/cruiserschoice_rules.cfm | - |
| Disallow | /news/news_print.cfm | - |
| Disallow | /news/script.txt | - |
| Disallow | /news/scroller.cfm | - |
| Disallow | /poll | - |
| Disallow | /polls/cookie.cfm | - |
| Disallow | /polls/index.cfm | - |
| Disallow | /polls/testwidget2.cfm | - |
| Disallow | /polls/testwidget3.cfm | - |
| Disallow | /polls/testwidget.cfm | - |
| Disallow | /ports/article_print.cfm | - |
| Disallow | /ports/directions_print.cfm | - |
| Disallow | /ports/minibreak_print.cfm | - |
| Disallow | /ports/newport_print.cfm | - |
| Disallow | /quizzes | - |
| Disallow | /reviews/cruiseline_print.cfm | - |
| Disallow | /reviews/review_print.cfm | - |
| Disallow | /rollcall/entry_cl.cfm | - |
| Disallow | /rollcall/partylist.cfm | - |
| Disallow | /rollcall/shipdropdown.cfm | - |
| Disallow | /rollcall/shipdropdown_boards.cfm | - |
| Disallow | /rollcall/shipdropdown_entry.cfm | - |
| Disallow | /rollcall/thank-you | - |
| Disallow | /search | - |
| Disallow | /vbulletin | - |
| Disallow | /virtual/virtual_print.cfm | - |
| Disallow | /work_data | - |
| Disallow | /v-*/* | - |
| Disallow | /smart-deals | - |
| Disallow | /hipship/ | - |
| Disallow | /static/manage-subscriptions/ | - |
| Disallow | /*sort%26 | x3D;* |
| Disallow | /*/dp/*deck%26 | x3D;* |
| Disallow | /helpers/ | - |
| Disallow | /sail-away | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cruisecritic.com.au/sitemaps/index.xml |
Comments