Discussion

Ask HN: What are the things LLM models fail at?

Generally, whenever I do see frontier AI model's evaluation metrics on say Artificial Analysis. It gives out a benchmark on a set of questions (or tasks). But it never quite actually shows what tasks it fails at. I'm more curious on benchmarks that focus on SWE.
1 points aqua_coder 12 days ago 0 comments

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton