Comment

Comment by pyryt

Good question. We don't collect the 'what lead to this code' data, such as agent traces, so I can't say for sure.

From my own experience, I would attribute most of bugs that I write to the agent not considering one of the many constraints it should consider. This could be it assuming a different shape of data, or not browsing the codebase thoroughly enough at some point during its work and missing a parallel, or it not testing an edge case because it didn't think of it, and so on.

So, I would place this more under the latter, 'missing requirements / details', bucket. But its not clear to me that I should be giving the requirements as a prompt. Similarly to a good engineer, an ideal agent would spend a good amount of time understanding all the requirements before completing work. This could include browsing the codebase more extensively, running more tests, asking me for details it cannot find, and so on.

parent pyryt 4 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton