Comment Comment by echelon These aren't the "small" models I'm thinking of.I want an LLM, STT, or TTS model to run efficiently on a Raspberry Pi with no GPU and no network.There is huge opportunity for LLM-based toys, tools, sensors, and the like. But they need to work sans internet. parent echelon 2 years ago
I want an LLM, STT, or TTS model to run efficiently on a Raspberry Pi with no GPU and no network.
There is huge opportunity for LLM-based toys, tools, sensors, and the like. But they need to work sans internet.