Comment by yamatokaneko

I think it’s a very interesting approach. Could be for a niche group, likely power users of LLMs who are often mobile and value privacy.

Any thoughts on how small this hardware could eventually become?