For the record, "the future" you are describing is running a tiny LLM from 2 years ago.
Those on-device weights are horribly outdated, underperform for their size, and cannot be updated to use a different model. I don't think Nvidia is afraid of Taalas.
Those on-device weights are horribly outdated, underperform for their size, and cannot be updated to use a different model. I don't think Nvidia is afraid of Taalas.