Comment

Comment by echelon

These aren't the "small" models I'm thinking of.

I want an LLM, STT, or TTS model to run efficiently on a Raspberry Pi with no GPU and no network.

There is huge opportunity for LLM-based toys, tools, sensors, and the like. But they need to work sans internet.

parent echelon 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton