Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5
Link: github.com/b4rtaz/distributed-…
Discussion: news.ycombinator.com/item?id=4…
[v0.16.0] Qwen3 30B A3B Q40 on 4 x Raspberry Pi 5 8GB · b4rtaz distributed-llama · Discussion #255
qwen3_30b.mov Setup Device: 4 x Raspberry Pi 5 8GB Distributed Llama version: 0.16.0 Model: qwen3_30b_a3b_q40 Benchmark Evaluation Prediction 4 x Raspberry Pi 5 8GB 14.33 tok/s 13.04 tok/s b4rtaz@r...GitHub
Zero
in reply to Sumire Uesaka (上坂すみれ) • • •△ TRiANG-ouL's avatar ▽
in reply to Zero • • •Zero
in reply to △ TRiANG-ouL's avatar ▽ • • •△ TRiANG-ouL's avatar ▽ likes this.
△ TRiANG-ouL's avatar ▽
in reply to Zero • • •