Comment

Comment by sgtwompwomp

Unfortunately these scripting tools just are untenable when dealing with so many desktop flows that all have changing UIs and random popups. You end up having to repair all of them all the time, in fact there's a whole consulting industry out there just to do this all day.

The whole idea of Cyberdesk is the prompt is the source of truth, and then once you learn a task once via CUA, the system follows that cache most of the time until you have to fall back to CUA, which follows the prompt. And that anomaly is also cached too.

So over time, the system just learns, and gets cheaper and faster.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton