Comment by mosselman

I meant things like bugs. So lets say some open source project has a bug that is later found, you could theoretically use that in a benchmark for an LLM to see if it can find it.