Comment by exploderate

Ah wow, that must be the most expensive mouse pointer ever. I wonder if it can also click links. I just tell AI to "click this" and it will figure out what is under the pointer, query a graph of UI widgets and trigger a "click" event for me. Maybe with a sub-agent that has application context, "this is a browser".

If we manage that, my plans for a pure XML based shell might not be too futuristic '<in><ls/></in><out><tree><file date="CDATA[...]">' ...