boatbound.co
robots.txt

Robots Exclusion Standard data for boatbound.co

Resource Scan

Scan Details

Site Domain boatbound.co
Base Domain boatbound.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-14T18:37:58+00:00
Next Scan 2024-11-12T18:37:58+00:00

Last Successful Scan

Scanned2023-03-31T18:35:17+00:00
URL https://boatbound.co/robots.txt
Redirect https://www.boatsetter.com/robots.txt
Redirect Domain www.boatsetter.com
Redirect Base boatsetter.com
Domain IPs 34.212.125.125, 52.27.193.179, 54.187.122.25
Redirect IPs 104.22.56.93, 104.22.57.93, 172.67.40.220, 2606:4700:10::6816:385d, 2606:4700:10::6816:395d, 2606:4700:10::ac43:28dc
Response IP 104.22.57.93
Found Yes
Hash d8ddd5300e18e06e1c056b4d8bbe53e60700c5774f322c5af923eea887376d5a
SimHash 8805bb15b160

Groups

*

Rule Path
Disallow /unsubscribe
Disallow /users/
Disallow /referrals
Disallow /terms_of_service_agree
Disallow /assets/algolia/
Disallow /assets/kissmetrics/
Disallow /bookings/itineraries/
Disallow /a/preview
Disallow /a/booking*
Disallow /bookings/*
Disallow /domestic/v1/*
Disallow /domestic/v2/*
Disallow /boating-resources/*/feed
Disallow /boats/*/similar_boats
Disallow /boats/*/load_boat_captains

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.boatsetter.com/sitemaps/sitemap.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file