salt-projects.be
robots.txt

Robots Exclusion Standard data for salt-projects.be

Resource Scan

Scan Details

Site Domain salt-projects.be
Base Domain salt-projects.be
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-03T03:30:11+00:00
Next Scan 2025-12-17T03:30:11+00:00

Last Successful Scan

Scanned2025-11-17T23:35:32+00:00
URL https://salt-projects.be/robots.txt
Domain IPs 176.62.173.122, 2a00:1c98:1000:1051::b2ff:3f5c
Response IP 176.62.173.122
Found Yes
Hash 2546e19a547a57339e81e9ee3fa19465f1af9c0401c3cb158e65d121a78ed1f3
SimHash 6370195627b5

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://salt-projects.be/nl/sitemaps-1-sitemap.xml

Comments

  • robots.txt for /nl/
  • live - don't allow web crawlers to index cpresources/ or vendor/