euphetar

Honestly I think we will get something in the middle. A lot of stuff will become API calls, but we will also have a lot of people-facing interfaces, and the need to use them automatically (for QA at the very least least). And then there are games

Sorry for the confusion, Steelman CTO here.

OSWorld (even the old ones, v1 and verified) runs the model in a full linux VM. And using the terminal is allowed. The models are given tools that provide a subset of possible UI actions. They then use them to open the terminal and script their way to solutions.

Even when this is prohibited, models hack their way around restrictions. Like in OSWorld v2 Claude Opus 4.8 inserts some JS in the browser search bar to execute it instead of playing the Chrome dinosaur.

WebArena is better in that regard because it doesn't allow to use the terminal. But it's worse in another regard: only allows limited actions and the tasks are only such that an agent can win by using a few pre-defined actions (click, scroll, new tab, etc). Which is a tiny subset of what real browser use is, in my opinion.

Agreed and a lot of companies seem to have their head in the sand, just hoping AI agents will magic their way through the legacy

But I don't think RPA is the way. Or at least, not in the current state. I think AI agents with proper computer use are what RPA should be. Usual RPA is too brittle and maintaining it often requires more work than just doing the work

I wouldn't call it a benchmark since it's just one sample. They do highlight a real problem, though. Computer use is immature right now and far behind language agents

Try playing fruit ninja via text and llm toolcalls though

No link to edits or specific article. Disappointed. This shouldn't be front page as it contains no substance besides speculation

People don't like having their time wasted

Appreciate the effort, but this is very basic and nothing you need the source code to understand. I was expecting a deep dive into what specific decisions they made, but not how an loop of tool calls works

Nice

While I do not have much sympathy for Altman, the article is very low quality and contains zero analysis

Yeah, maybe on the surface chatbots turned out to be chatbots. But you have to be a poor journalist to stop your investigation of the issue at that and conclude AI is no big deal. Nuance, anyone?

the tidbit didn't work though, I just tried with GPT-4o

It's 100% clear why his I initiative was buried. The guy is a reckless egomaniac jerk. He is very transparent that he would do illegal stuff on a whim, target civillians, escalate conflict with other nations without even consulting a superior, and then reveal his face to the whole world, spilling secrets left and right, for a minute of internet publicity. And do a reddit AMA. And put "I am single LOL" there, showing just how much he can be trusted with leading a government cyberwarfare task force

What I read is that guy did a clever DDoS, which is mildly impressive, and decided to become a twitter celebrity/NK assassination victim. I am no hacker, but I expect real hackers to be laughing their asses off.

Please provide a feature to load data from notion export