Recent submissions

Comment · 4 months ago
Good question. We don't collect the 'what lead to this code' data, such as agent traces, so I can't say for sure.

From my own experience, I would attribute most of bugs that I write to the agent not considering one of the many constraints it should consider. This could be it assuming a different shape of data, or not browsing the codebase thoroughly enough at some point during its work and missing a parallel, or it not testing an edge case because it didn't think of it, and so on.

So, I would place this more under the latter, 'missing requirements / details', bucket. But its not clear to me that I should be giving the requirements as a prompt. Similarly to a good engineer, an ideal agent would spend a good amount of time understanding all the requirements before completing work. This could include browsing the codebase more extensively, running more tests, asking me for details it cannot find, and so on.

Comment · 4 months ago
Author here. In short:

- We launched an AI bug scanner 6 months ago. We wanted to know what the bugs that get fixed have in common.

- We clustered 1,000 bugs from 99 codebases and grouped them by failure mechanism.

- 21 recurring mechanisms cover 70% of the bugs. These same mistakes show up again and again in completely unrelated products. We seem to be writing similar bugs over and over again with agents.

- A common denominator is silence. Bugs that make it to production today are not easily ‘legible’. They don’t crash, they pass CI, they look fine. You don’t see them unless you look for them.

If you’d like to know anything else about these bugs, let us know. Happy to analyze the dataset further.

Comment · 1 year ago
I would love to do this on my codebase after every commit
Comment · 1 year ago
Comment · 2 years ago
This looks promising! Does any LLM understand Instantdb yet?
Comment · 2 years ago
For comparison, manslaughter average sentence in Finland seems to be around 9.5 yrs
Comment · 2 years ago
You can get the ball off the ground if you turn your phone upside down. Then you can just sort of fly over the places where you'd normally fall. Takes maybe a minute or two to complete all the levels.
Comment · 2 years ago
Ive enjoyed the classical sales books like SPIN selling, Challenger sale, Fanatical prospecting, The Psychology of Selling.
Comment · 2 years ago
Has anyone experimented with integrating real-time lipsync into a low-latency audio bot? I saw some demos with d-id but their pricing was closer to $1/minute which makes it rather prohibitive
Comment · 2 years ago
Interesting project, thanks for sharing
Comment · 2 years ago
Knowing when to speak is actually a prediction task in itself. See eg https://arxiv.org/abs/2010.10874

Would be indeed great to get something like this integrated with whisper, LLM and TTS

Comment · 2 years ago
Do you have use case demo videos somewhere? Would be great to see this in action
Comment · 3 years ago
Comment · 3 years ago
Thank you! I had not come across this before

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton