pocruises.co.nz
robots.txt
Robots Exclusion Standard data for pocruises.co.nz
Resource Scan
Scan Details
| Site Domain | pocruises.co.nz |
| Base Domain | pocruises.co.nz |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-16T02:24:26+00:00 |
| Next Scan | 2024-11-14T02:24:26+00:00 |
Last Successful Scan
| Scanned | 2023-09-28T15:46:31+00:00 |
| URL | https://pocruises.co.nz/robots.txt |
| Redirect | https://www.pocruises.co.nz/robots.txt |
| Redirect Domain | www.pocruises.co.nz |
| Redirect Base | pocruises.co.nz |
| Domain IPs | 23.101.213.120 |
| Redirect IPs | 23.32.29.89, 23.32.29.97 |
| Response IP | 23.215.7.22 |
| Found | Yes |
| Hash | 4207d518a5331b15a115a73d578571890f17ee11e5bf4714f4f635148dc36e6d |
| SimHash | e0493c5cdf91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
| Disallow | /cruises/search |
| Disallow | /experiences/search |
| Disallow | /deals/advantage-long-cruise |
| Disallow | /advantage-long-cruise |
| Disallow | /deals/advantage-short-cruise |
| Disallow | /advantage-short-cruise |
| Disallow | /deals/privilege-cruise-offer |
| Disallow | /privilege-cruise-offer |
| Disallow | /website/globals |
| Disallow | */reviews?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pocruises.com.au/sitemap.xml |
Warnings
- 1 invalid line.