boatsetter.com
robots.txt
Robots Exclusion Standard data for boatsetter.com
Resource Scan
Scan Details
| Site Domain | boatsetter.com |
| Base Domain | boatsetter.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T11:27:05+00:00 |
| Next Scan | 2024-10-05T11:27:05+00:00 |
Last Scan
| Scanned | 2024-09-21T11:27:05+00:00 |
| URL | https://boatsetter.com/robots.txt |
| Redirect | https://www.boatsetter.com/robots.txt |
| Redirect Domain | www.boatsetter.com |
| Redirect Base | boatsetter.com |
| Domain IPs | 107.21.10.85, 54.86.30.65, 54.89.138.102 |
| Redirect IPs | 107.21.10.85, 54.86.30.65, 54.89.138.102 |
| Response IP | 54.86.30.65 |
| Found | Yes |
| Hash | 297fedd776099225425a79e87f82573ca79e4a0efacd4a4460ebff9fc6ffdfd9 |
| SimHash | 8805bf95b1e0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /unsubscribe |
| Disallow | /users/ |
| Disallow | /referrals |
| Disallow | /terms_of_service_agree |
| Disallow | /assets/algolia/ |
| Disallow | /assets/kissmetrics/ |
| Disallow | /bookings/itineraries/ |
| Disallow | /a/preview |
| Disallow | /a/booking* |
| Disallow | /bookings/* |
| Disallow | /domestic/v1/* |
| Disallow | /domestic/v2/* |
| Disallow | /boating-resources/*/feed |
| Disallow | /boats/*/similar_boats |
| Disallow | /boats/*/load_boat_captains |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.boatsetter.com/sitemaps/sitemap.xml |
Comments