Log In Sign Up

yachtworld.co.uk
robots.txt

Robots Exclusion Standard data for yachtworld.co.uk

Resource Scan

Scan Details

Site Domain yachtworld.co.uk
Base Domain yachtworld.co.uk
Scan Status Ok
Last Scan2024-09-21T03:07:12+00:00
Next Scan 2024-09-28T03:07:12+00:00

Last Scan

Scanned2024-09-21T03:07:12+00:00
URL https://yachtworld.co.uk/robots.txt
Redirect https://www.yachtworld.co.uk:443/robots.txt
Redirect Domain www.yachtworld.co.uk
Redirect Base yachtworld.co.uk
Domain IPs 3.164.182.43, 3.164.182.45, 3.164.182.57, 3.164.182.73
Redirect IPs 3.164.182.43, 3.164.182.45, 3.164.182.57, 3.164.182.73
Response IP 52.85.49.56
Found Yes
Hash 2c3b79c02b9b652aee511ab4625b6d39269c9ec5801c1465afe0bfbf6027ceae
SimHash bd111fc8cf77

Groups

*

Rule Path
Disallow /includes/
Disallow /byp/editbyplisting.cgi?company_id=New
Disallow /byp/yellowpages/changebyppasswd.cgi
Disallow /byp/yellowpages/editbyplisting.cgi
Disallow /byp/bypemail.cgi*
Disallow /*email.cgi*
Disallow /core/byp/yellowpages/changebyppassword.jsp
Disallow /core/byp/forgotbyppassword.jsp
Disallow /core/byp/forbidden_byp.jsp
Disallow /core/rendering/print-boat.htm
Disallow /core/listing/*
Disallow /core/globalnav/emailForm.jsp
Disallow /core/globalnav/localeSelect.jsp
Disallow /core/members/memberAccess.jsp
Disallow /privatelabel/listing/*
Disallow /locale/*
Disallow /listing/*
Disallow /core/listing*
Disallow /core/sponsored*
Disallow /252108799/Yachtworld*
Disallow /core/byp*
Disallow /core/rendering*
Back to top

Other Records

Field Value
sitemap https://www.yachtworld.co.uk/sitemap-index-uk.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • ( including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com ) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.yachtworld.co.uk/core/globalnav/termOfUse.jsp for more information.
Back to top