That's something I have been working on because I want to decouple work from the agent. In my opinion, work should be treated as a first-class object.
A long running work could have many attempts, failures and retries should be aggregated into the same result.
An acceptance of a work result should not be inferred as "the model said it is done", but be recorded as a human approval.
To calculate the cost of the whole work, the outcome and verified result of each attempt must all be saved.
I don't have a final method to measure human effort, right now I start by recording recovery, review and explicit acceptance events, the at least we have data to analyze.
A long running work could have many attempts, failures and retries should be aggregated into the same result.
An acceptance of a work result should not be inferred as "the model said it is done", but be recorded as a human approval.
To calculate the cost of the whole work, the outcome and verified result of each attempt must all be saved.
I don't have a final method to measure human effort, right now I start by recording recovery, review and explicit acceptance events, the at least we have data to analyze.
I'm exploring this in a work-runtime project: https://github.com/kungfu-systems/kungfu