boatbound.co
robots.txt
Robots Exclusion Standard data for boatbound.co
Resource Scan
Scan Details
Site Domain | boatbound.co |
Base Domain | boatbound.co |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-08-14T18:37:58+00:00 |
Next Scan | 2024-11-12T18:37:58+00:00 |
Last Successful Scan
Scanned | 2023-03-31T18:35:17+00:00 |
URL | https://boatbound.co/robots.txt |
Redirect | https://www.boatsetter.com/robots.txt |
Redirect Domain | www.boatsetter.com |
Redirect Base | boatsetter.com |
Domain IPs | 34.212.125.125, 52.27.193.179, 54.187.122.25 |
Redirect IPs | 104.22.56.93, 104.22.57.93, 172.67.40.220, 2606:4700:10::6816:385d, 2606:4700:10::6816:395d, 2606:4700:10::ac43:28dc |
Response IP | 104.22.57.93 |
Found | Yes |
Hash | d8ddd5300e18e06e1c056b4d8bbe53e60700c5774f322c5af923eea887376d5a |
SimHash | 8805bb15b160 |
Groups
*
Rule | Path |
---|---|
Disallow | /unsubscribe |
Disallow | /users/ |
Disallow | /referrals |
Disallow | /terms_of_service_agree |
Disallow | /assets/algolia/ |
Disallow | /assets/kissmetrics/ |
Disallow | /bookings/itineraries/ |
Disallow | /a/preview |
Disallow | /a/booking* |
Disallow | /bookings/* |
Disallow | /domestic/v1/* |
Disallow | /domestic/v2/* |
Disallow | /boating-resources/*/feed |
Disallow | /boats/*/similar_boats |
Disallow | /boats/*/load_boat_captains |
Other Records
Field | Value |
---|---|
sitemap | https://www.boatsetter.com/sitemaps/sitemap.xml |
Comments