Comment

Comment by itake

I am cautiously optimistic, but the reality is these models are huge. LLama 7b is 13g. Even if there is enough cpu cycles, the phone's storage can't support multiple models (and there will need to be multiple models).

Compare that to cloud, you can run the latest and greatest model and effectively unlimited storage.

parent itake 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton