Log In Sign Up

nl.boats.com
robots.txt

Robots Exclusion Standard data for nl.boats.com

Resource Scan

Scan Details

Site Domain nl.boats.com
Base Domain boats.com
Scan Status Ok
Last Scan2024-06-05T09:42:23+00:00
Next Scan 2024-06-19T09:42:23+00:00

Last Scan

Scanned2024-06-05T09:42:23+00:00
URL https://nl.boats.com/robots.txt
Domain IPs 108.139.10.118, 108.139.10.44, 108.139.10.50, 108.139.10.96
Response IP 108.157.60.28
Found Yes
Hash 87272219f581661822d044047c879d1d4ba80d6eab5c1cfc3fc11d67c4ee838d
SimHash 3d13ddda4fe7

Groups

*

Rule Path
Disallow /my-boats/
Disallow /sites/
Disallow /listing/
Allow /boottransport/
Disallow /boottransport/?b=*
Allow /boat-transport/index.jsp
Disallow /boat-transport/index.jsp?yw_country=*
Disallow /boten-te-koop/*sort%3D
Disallow /boten-te-koop/*currency%3D
Disallow /boten-te-koop/*length%3D
Disallow /boten-te-koop/*price%3D
Disallow /boten-te-koop/*year%3D
Disallow /boten-te-koop/*condition%3Dall-in-stock
Disallow /boten-te-koop/*condition%3Dnew-in-stock
Disallow /boten-te-koop/*condition%3Dnew-models
Disallow /boten-te-koop/*hull-material%3D
Disallow /boten-te-koop/*fuel-type%3D
Disallow /boten-te-koop/*created%3D
Disallow /boten-te-koop/*media-type%3D
Disallow /boten-te-koop/*activity%3D
Disallow *keyword%3D
Disallow *type-class%3D
Disallow *typeClass%3D
Disallow *?p=
Disallow *?locale=
Disallow *?redirect=
Disallow /boats.serv*
Disallow /engines/engine_details_frame.jsp*
Disallow /dealer/
Disallow /boats/contact/email_seller.html
Disallow /252108799/Boats*
Back to top

Other Records

Field Value
sitemap https://nl.boats.com/sitemap.xml
Back to top

Comments

  • Prod Test
  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • (including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.boatsgroup.com/terms-of-use/ for more information.
Back to top