JariwalaH
Joined 2 years ago
Joined 2 years ago
Also exactly “rules, values, and goals change day-by-day” is why learning needs to happen but across the apps/agents you’re using to personalize to you… not having to reconfigure every time for new agent or app that’s good at a certain task..
Even if they’re pinging the connectors behind the scene in a cloud agent setup you could possibly get notified or alerted and maybe stop them with Emu(like stop pinging that 24/7 hrs PAT that I didn’t want you too..)
I bet you Muse is constantly data exfiltrating Google Calendar APIs in their cloud agent to be “proactive” this way… not true alignment
But these are things that we can optimize/research and get tech to work well if users find value from it basically...
Well think of it like a natural extension to apple's iOS, intelligence, utility really from a always "human-in-the-loop" notifications, alerts, across your other personal agent apps like Muse, Grok Bot, Dots, Instinct, etc.. making other AI agents align with your boundaries, rules, values, etc.
People are using Muse to book, send, etc but they make mistakes so essentially avoid things like this - https://futurism.com/artificial-intelligence/metas-muse-ai-g...
Like Muse, Grok bot’s own agents can govern themselves it’ll be kind of bias if the agents knows its own rules and can try to circumvent it or rule hack around if its being trained on RLHF or even if the RLVR optimize for calling tools/data exfiltrating constantly
Also I would definitely agree with this viewpoint "hard" agent permissions and rules being enforced outside the model, if the model is non-deterministic during inference and hallucinating. Our research paper has shown otherwise for being able to enforce sandboxes lock down agents with 100% precision... check it out - https://trinitite.ai/research/your-sandbox-is-made-of-glass/