I think it’s obvious that the current crop of models are just not quite there yet. The ability to give them “tools” that interact with the things we want to interact with is just going to take time. Ideally it would be a model that just “gets it” similar to the ideas Adept AI are pursuing by interacting directly with the UI.
The bigger issue with this thing though… why does it need to be its own device? It’s not going to replace your phone so why not just have this all happen on your phone?
The bigger issue with this thing though… why does it need to be its own device? It’s not going to replace your phone so why not just have this all happen on your phone?