Log In Sign Up

boattrader.com
robots.txt

Robots Exclusion Standard data for boattrader.com

Resource Scan

Scan Details

Site Domain boattrader.com
Base Domain boattrader.com
Scan Status Ok
Last Scan2024-11-03T21:10:43+00:00
Next Scan 2024-11-10T21:10:43+00:00

Last Scan

Scanned2024-11-03T21:10:43+00:00
URL https://boattrader.com/robots.txt
Redirect https://www.boattrader.com:443/robots.txt
Redirect Domain www.boattrader.com
Redirect Base boattrader.com
Domain IPs 3.212.203.105, 3.222.150.183, 34.237.231.221, 44.206.115.207, 52.204.105.67, 54.147.101.253
Redirect IPs 108.138.7.114, 108.138.7.121, 108.138.7.126, 108.138.7.98
Response IP 65.9.112.105
Found Yes
Hash 7a18f8d544e41c86d1b5a5ecb44f700be9e35ff75132a128967c1396b4d0e602
SimHash 28515d39cff7

Groups

*

Rule Path
Disallow /252108799/BoatTrader/*
Disallow /*?refSource
Disallow /featured-photos/
Disallow */other/
Disallow /listing/print/
Disallow /listing/photos/
Disallow /listing/photos/print/
Disallow /myt/
Disallow /dealers/email
Disallow /oauth-redirect/
Disallow /boat-loans/apply/
Disallow */sort
Disallow *?sort
Disallow *sortby-
Disallow *SortBy-
Disallow *Show-
Disallow *PhotoOnly-
Disallow *PerPage-
Disallow *ViewType-
Disallow /search-results/
Disallow /email
Disallow /dealers/*/*/*/*
Disallow /myboats/*
Disallow /getmap.php*

vast_bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.boattrader.com/sitemap-index-en.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • (including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.boatsgroup.com/terms-of-use/ for more information.
Back to top