Log In Sign Up

yachtworld.no
robots.txt

Robots Exclusion Standard data for yachtworld.no

Resource Scan

Scan Details

Site Domain yachtworld.no
Base Domain yachtworld.no
Scan Status Ok
Last Scan2024-06-28T02:15:05+00:00
Next Scan 2024-07-05T02:15:05+00:00

Last Scan

Scanned2024-06-28T02:15:05+00:00
URL https://yachtworld.no/robots.txt
Redirect https://no.yachtworld.com:443/robots.txt
Redirect Domain no.yachtworld.com
Redirect Base yachtworld.com
Domain IPs 18.238.217.100, 18.238.217.115, 18.238.217.2, 18.238.217.50
Redirect IPs 18.238.217.100, 18.238.217.115, 18.238.217.2, 18.238.217.50
Response IP 18.165.171.23
Found Yes
Hash 89b7738715ad6bc422d1850635c396360fe1be3637525b0fe1fe1a4bf484d52b
SimHash 3c111fc8cf73

Groups

*

Rule Path
Disallow /includes/
Disallow /byp/editbyplisting.cgi?company_id=New
Disallow /byp/yellowpages/changebyppasswd.cgi
Disallow /byp/yellowpages/editbyplisting.cgi
Disallow /byp/bypemail.cgi*
Disallow /*email.cgi*
Disallow /core/byp/yellowpages/changebyppassword.jsp
Disallow /core/byp/forgotbyppassword.jsp
Disallow /core/byp/forbidden_byp.jsp
Disallow /core/rendering/print-boat.htm
Disallow /core/listing/*
Disallow /core/globalnav/emailForm.jsp
Disallow /core/globalnav/localeSelect.jsp
Disallow /core/members/memberAccess.jsp
Disallow /privatelabel/listing/*
Disallow /locale/*
Disallow /listing/*
Disallow /core/listing*
Disallow /core/sponsored*
Disallow /252108799/Yachtworld*
Disallow /core/byp*
Disallow /core/rendering*
Back to top

Other Records

Field Value
sitemap https://no.yachtworld.com/sitemap-index-no.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • ( including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com ) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://no.yachtworld.com/core/globalnav/termOfUse.jsp for more information.
Back to top