Maybe it’s just me but (and I ask this as something of an ML practitioner myself) can anyone at Anthropic or Open AI or any of the frontier labs work on summarizing content into a format where a human won’t immediately vomit?
There’s this sort of local optima all these models pick which is instantly recognizable and hardly digestible for human consumption. Perhaps too much internal RL against benchmarks during chain of thought? The older non reasoning models had they’re own problems but at this point I can’t get an LLM to summarize data for humans, which is troubling.
As much as I’d like to read this piece it follows suit and I don’t have the patience to try and extract anything valuable from it.
There’s this sort of local optima all these models pick which is instantly recognizable and hardly digestible for human consumption. Perhaps too much internal RL against benchmarks during chain of thought? The older non reasoning models had they’re own problems but at this point I can’t get an LLM to summarize data for humans, which is troubling.
As much as I’d like to read this piece it follows suit and I don’t have the patience to try and extract anything valuable from it.