Comment by pmoriarty

Why would you need the LLM to be running on the device itself? Wouldn't it be more efficient for the intelligence to be more centralized? Maybe in one central computer per home, or (probably even more desirable for corporations) for the devices to phone home to a centralized server at the service provider in the cloud somewhere.