Log In Sign Up

static-cdn.boattrader.com
robots.txt

Robots Exclusion Standard data for static-cdn.boattrader.com

Resource Scan

Scan Details

Site Domain static-cdn.boattrader.com
Base Domain boattrader.com
Scan Status Ok
Last Scan2024-05-11T07:46:13+00:00
Next Scan 2024-05-18T07:46:13+00:00

Last Scan

Scanned2024-05-11T07:46:13+00:00
URL https://static-cdn.boattrader.com/robots.txt
Redirect https://www.boattrader.com:443/robots.txt
Redirect Domain www.boattrader.com
Redirect Base boattrader.com
Domain IPs 34.233.166.65, 44.197.135.205, 52.2.211.66, 52.2.98.246, 54.210.226.42, 54.83.255.43
Redirect IPs 18.65.25.27, 18.65.25.77, 18.65.25.86, 18.65.25.95
Response IP 18.165.171.18
Found Yes
Hash ebbc5edc5fcc8a214a6ddff3a5041be883ef957eae8e87d3759f78fe9d4a22f6
SimHash 28515d3bcffb

Groups

*

Rule Path
Disallow /252108799/BoatTrader/*
Disallow /*?refSource
Disallow /featured-photos/
Disallow */other/
Disallow /listing/print/
Disallow /listing/photos/
Disallow /listing/photos/print/
Disallow /myt/
Disallow /dealers/email
Disallow /oauth-redirect/
Disallow /boat-loans/apply/
Disallow /*?*
Disallow */sort
Disallow *?sort
Disallow *sortby-
Disallow *SortBy-
Disallow *Show-
Disallow *PhotoOnly-
Disallow *PerPage-
Disallow *ViewType-
Disallow /search-results/
Disallow /email
Disallow /dealers/*/*/*/*
Disallow /myboats/*
Disallow /getmap.php*

vast_bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.boattrader.com/sitemap-index-en.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • (including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.boatsgroup.com/terms-of-use/ for more information.
Back to top