Log In Sign Up

botentekoop.nl
robots.txt

Robots Exclusion Standard data for botentekoop.nl

Resource Scan

Scan Details

Site Domain botentekoop.nl
Base Domain botentekoop.nl
Scan Status Ok
Last Scan2024-09-21T20:57:45+00:00
Next Scan 2024-09-28T20:57:45+00:00

Last Scan

Scanned2024-09-21T20:57:45+00:00
URL https://botentekoop.nl/robots.txt
Redirect https://www.botentekoop.nl:443/robots.txt
Redirect Domain www.botentekoop.nl
Redirect Base botentekoop.nl
Domain IPs 3.221.3.98, 34.225.24.217, 34.227.62.114, 44.194.245.29, 44.206.161.200, 52.0.104.68
Redirect IPs 2600:9000:2024:1e00:18:6c6e:2780:93a1, 2600:9000:2024:2800:18:6c6e:2780:93a1, 2600:9000:2024:2e00:18:6c6e:2780:93a1, 2600:9000:2024:5c00:18:6c6e:2780:93a1, 2600:9000:2024:ca00:18:6c6e:2780:93a1, 2600:9000:2024:da00:18:6c6e:2780:93a1, 2600:9000:2024:f400:18:6c6e:2780:93a1, 2600:9000:2024:f800:18:6c6e:2780:93a1, 65.9.112.100, 65.9.112.13, 65.9.112.28, 65.9.112.91
Response IP 18.165.122.43
Found Yes
Hash cbaa5889f7af5ca063db574e51bbe8218ae1e708d394dbd5caa95ed216f56c14
SimHash 38511dd9cff7

Groups

*

Rule Path
Disallow /boten/soort-bijgewerkt%3Adesc/
Back to top

Other Records

Field Value
sitemap https://www.botentekoop.nl/sitemap-index-nl.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from any Boats Group hosted web sites
  • (including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
  • and soldboats.com) without the express written permission of Boats Group
  • is strictly prohibited.
  • Boats Group may permit access to Boats Group hosted web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the marine industry
  • and do not frame or otherwise obscure any Boats Group hosted web sites.
  • Please read our Terms of Use at
  • https://www.boatsgroup.com/terms-of-use/ for more information.
Back to top