yachtworld.nl
robots.txt

Robots Exclusion Standard data for yachtworld.nl

Resource Scan

Scan Details

Site Domain yachtworld.nl
Base Domain yachtworld.nl
Scan Status Ok
Last Scan2024-11-15T02:20:36+00:00
Next Scan 2024-11-22T02:20:36+00:00

Last Scan

Scanned2024-11-15T02:20:36+00:00
URL https://yachtworld.nl/robots.txt
Redirect https://nl.yachtworld.com:443/robots.txt
Redirect Domain nl.yachtworld.com
Redirect Base yachtworld.com
Domain IPs 13.226.2.113, 13.226.2.30, 13.226.2.56, 13.226.2.86
Redirect IPs 3.164.182.43, 3.164.182.45, 3.164.182.57, 3.164.182.73
Response IP 52.85.49.61
Found Yes
Hash e409a8b74a474388d69052ad0e4d73e02f6f70c423c80c31efa7c08fd21e4235
SimHash 3d111bc8c773

Groups

*

Rule Path
Disallow /includes/
Disallow /byp/editbyplisting.cgi?company_id=New
Disallow /byp/yellowpages/changebyppasswd.cgi
Disallow /byp/yellowpages/editbyplisting.cgi
Disallow /byp/bypemail.cgi*
Disallow /*email.cgi*
Disallow /core/byp/yellowpages/changebyppassword.jsp
Disallow /core/byp/forgotbyppassword.jsp
Disallow /core/byp/forbidden_byp.jsp
Disallow /core/rendering/print-boat.htm
Disallow /core/listing/*
Disallow /core/globalnav/emailForm.jsp
Disallow /core/globalnav/localeSelect.jsp
Disallow /core/members/memberAccess.jsp
Disallow /privatelabel/listing/*
Disallow /locale/*
Disallow /listing/*
Disallow /core/listing*
Disallow /core/sponsored*
Disallow /252108799/Yachtworld*
Disallow /core/byp*
Disallow /core/rendering*
Disallow /?srs*

Other Records

Field Value
sitemap https://nl.yachtworld.com/sitemap-index-nl.xml

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • ( including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com ) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://nl.yachtworld.com/core/globalnav/termOfUse.jsp for more information.