Log In Sign Up

boattrader.com
robots.txt

Robots Exclusion Standard data for boattrader.com

Resource Scan

Scan Details

Site Domain boattrader.com
Base Domain boattrader.com
Scan Status Ok
Last Scan2024-05-12T05:26:11+00:00
Next Scan 2024-05-19T05:26:11+00:00

Last Scan

Scanned2024-05-12T05:26:11+00:00
URL https://boattrader.com/robots.txt
Redirect https://www.boattrader.com:443/robots.txt
Redirect Domain www.boattrader.com
Redirect Base boattrader.com
Domain IPs 3.213.230.98, 3.218.140.99, 34.205.120.216, 44.208.51.183, 44.215.59.207, 54.243.130.2
Redirect IPs 18.161.6.116, 18.161.6.121, 18.161.6.30, 18.161.6.37
Response IP 18.165.171.118
Found Yes
Hash ebbc5edc5fcc8a214a6ddff3a5041be883ef957eae8e87d3759f78fe9d4a22f6
SimHash 28515d3bcffb

Groups

*

Rule Path
Disallow /252108799/BoatTrader/*
Disallow /*?refSource
Disallow /featured-photos/
Disallow */other/
Disallow /listing/print/
Disallow /listing/photos/
Disallow /listing/photos/print/
Disallow /myt/
Disallow /dealers/email
Disallow /oauth-redirect/
Disallow /boat-loans/apply/
Disallow /*?*
Disallow */sort
Disallow *?sort
Disallow *sortby-
Disallow *SortBy-
Disallow *Show-
Disallow *PhotoOnly-
Disallow *PerPage-
Disallow *ViewType-
Disallow /search-results/
Disallow /email
Disallow /dealers/*/*/*/*
Disallow /myboats/*
Disallow /getmap.php*

vast_bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.boattrader.com/sitemap-index-en.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • (including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.boatsgroup.com/terms-of-use/ for more information.
Back to top