ESP32S3 cluster running 1.58-bit (BitNet) Language model

 (github.com)

42 points | by nkko 5 hours ago

5 comments

  • NDlurker 19 minutes ago
    I'm curious how this would handle grammar checking on a basic word processor. Or maybe generate worlds for small text based games. I have no idea what the capabilities are of a cluster like this.
  • matthewfcarlson 20 minutes ago
    I’m actually working on a small project that’s exactly this! Less quant so it’s only 150M parameters but this is amazing.
  • tdhz77 56 minutes ago
    Soon ai in every lightbulb running Kubernetes
  • cameron_b 2 hours ago
    It is a bit of a bummer to see that the degree of 'compression' makes it a fancy llm noise-maker. It is still charming.
  • sjakati98 1 hour ago
    Gemma 4 when?