Log In Sign Up

yachtworld.com
robots.txt

Robots Exclusion Standard data for yachtworld.com

Resource Scan

Scan Details

Site Domain yachtworld.com
Base Domain yachtworld.com
Scan Status Ok
Last Scan2024-05-19T17:16:53+00:00
Next Scan 2024-05-26T17:16:53+00:00

Last Scan

Scanned2024-05-19T17:16:53+00:00
URL https://yachtworld.com/robots.txt
Redirect https://www.yachtworld.com:443/robots.txt
Redirect Domain www.yachtworld.com
Redirect Base yachtworld.com
Domain IPs 3.163.24.22, 3.163.24.34, 3.163.24.6, 3.163.24.95
Redirect IPs 108.156.201.13, 108.156.201.66, 108.156.201.84, 108.156.201.87
Response IP 18.165.171.23
Found Yes
Hash 397725a60c41116a4e26f5c8fee9766a87ff36123d08b80fbdbed1f0b48317c9
SimHash bd111fc8cf73

Groups

*

Rule Path
Disallow /boats-for-sale/advanced/
Disallow /includes/
Disallow /byp/editbyplisting.cgi?company_id=New
Disallow /byp/yellowpages/changebyppasswd.cgi
Disallow /byp/yellowpages/editbyplisting.cgi
Disallow /byp/bypemail.cgi*
Disallow /*email.cgi*
Disallow /core/byp/yellowpages/changebyppassword.jsp
Disallow /core/byp/forgotbyppassword.jsp
Disallow /core/byp/forbidden_byp.jsp
Disallow /core/rendering/print-boat.htm
Disallow /core/listing/*
Disallow /core/globalnav/emailForm.jsp
Disallow /core/globalnav/localeSelect.jsp
Disallow /core/members/memberAccess.jsp
Disallow /privatelabel/listing/*
Disallow /locale/*
Disallow /listing/*
Disallow /core/listing*
Disallow /core/sponsored*
Disallow /252108799/Yachtworld*
Disallow /core/byp*
Disallow /core/rendering*
Back to top

Other Records

Field Value
sitemap https://www.yachtworld.com/sitemap-index-us.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • ( including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com ) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.yachtworld.com/core/globalnav/termOfUse.jsp for more information.
Back to top