boerolivier.be
robots.txt

Robots Exclusion Standard data for boerolivier.be

Resource Scan

Scan Details

Site Domain boerolivier.be
Base Domain boerolivier.be
Scan Status Ok
Last Scan2025-12-01T03:17:10+00:00
Next Scan 2025-12-08T03:17:10+00:00

Last Scan

Scanned2025-12-01T03:17:10+00:00
URL https://boerolivier.be/robots.txt
Redirect https://www.boerolivier.be/robots.txt
Redirect Domain www.boerolivier.be
Redirect Base boerolivier.be
Domain IPs 188.208.36.64, 2a00:1c98:1000:1253:0:3:4974:1014
Redirect IPs 188.208.36.64, 2a00:1c98:1000:1253:0:3:4974:1014
Response IP 188.208.36.64
Found Yes
Hash 96b435db6941d399c49a55e3ec8dc30fa1da38a2168aea4f2fc6d9b8e5a2886d
SimHash 61781d563797

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.boerolivier.be/nl/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.boerolivier.be/nl/
  • live - don't allow web crawlers to index cpresources/ or vendor/