Log In Sign Up

botentekoop.nl
robots.txt

Robots Exclusion Standard data for botentekoop.nl

Resource Scan

Scan Details

Site Domain botentekoop.nl
Base Domain botentekoop.nl
Scan Status Ok
Last Scan2024-11-10T01:14:12+00:00
Next Scan 2024-11-17T01:14:12+00:00

Last Scan

Scanned2024-11-10T01:14:12+00:00
URL https://botentekoop.nl/robots.txt
Redirect https://www.botentekoop.nl:443/robots.txt
Redirect Domain www.botentekoop.nl
Redirect Base botentekoop.nl
Domain IPs 18.205.8.116, 18.209.215.253, 3.86.79.152, 34.194.56.90, 35.169.253.244, 52.205.29.4
Redirect IPs 2600:9000:2795:4e00:18:6c6e:2780:93a1, 2600:9000:2795:9800:18:6c6e:2780:93a1, 2600:9000:2795:c400:18:6c6e:2780:93a1, 2600:9000:2795:c600:18:6c6e:2780:93a1, 2600:9000:2795:d200:18:6c6e:2780:93a1, 2600:9000:2795:e600:18:6c6e:2780:93a1, 2600:9000:2795:f800:18:6c6e:2780:93a1, 2600:9000:2795:fe00:18:6c6e:2780:93a1, 3.164.85.111, 3.164.85.128, 3.164.85.42, 3.164.85.98
Response IP 18.165.122.43
Found Yes
Hash cbaa5889f7af5ca063db574e51bbe8218ae1e708d394dbd5caa95ed216f56c14
SimHash 38511dd9cff7

Groups

*

Rule Path
Disallow /boten/soort-bijgewerkt%3Adesc/
Back to top

Other Records

Field Value
sitemap https://www.botentekoop.nl/sitemap-index-nl.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • (including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.boatsgroup.com/terms-of-use/ for more information.
Back to top