bosschaerts.be
robots.txt

Robots Exclusion Standard data for bosschaerts.be

Resource Scan

Scan Details

Site Domain bosschaerts.be
Base Domain bosschaerts.be
Scan Status Ok
Last Scan2026-02-18T06:25:32+00:00
Next Scan 2026-03-20T06:25:32+00:00

Last Scan

Scanned2026-02-18T06:25:32+00:00
URL https://bosschaerts.be/robots.txt
Domain IPs 2a02:2350:5:102:80e3:11b8:d546:2934, 77.111.240.188
Response IP 77.111.240.188
Found Yes
Hash 66be76c8f1ad7feee6903dd50678b5ef18baf271a9c457aceec6286b4985823b
SimHash 6b28e26287d7

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Disallow /bossback/
Disallow /bossdata/
Disallow /languages/
Disallow /webmenu/
Disallow /13-gb/
Disallow /13-lgb/
Disallow /genealogy/admin/
Disallow /genealogy/bossback/
Disallow /genealogy/bossdata/
Disallow /genealogy/languages/
Disallow /genealogy/webmenu/
Disallow /genealogy/13-gb/

Other Records

Field Value
crawl-delay 1

Warnings

  • `https` is not a known field.