Comment by verdverm

Battery usage, people don't want their phone to go into coma so quickly

I'm not even sure what I need an LLM to do with/on my phone, what are people using these things for?

Also, I have zero trust for Jev like models and use rerankers/policy-tuned llms for some of what you are concerned with