happycube
Joined 14 years ago
Joined 14 years ago
That said, I do want good local(ish) capability for if/when Anthropic enshittifies again. And to play with very useful smaller models - don't even count gemma 4 out.
4.1 is much larger, even leaving out the PLE.
With Flash Next you only have ~6B active parameters so you can toss experts up into VRAM and/or run them on a CPU if you have enough RAM and bandwidth.
If they were still at original price I'd get a couple of DGX Sparks myself to run Flash models at a decent quant/context combo.
More related: What can an abliterated Qwen 3.8 28B do?
Although I could see a version of this with two RP2350's.
The problem is Apple II 3.5" disks are in GCR so you would need a custom controller (IMO certainly doable with an RP2040 let alone RP2350) that is not bound to just PC formats.