Wheen
Joined 15 years ago
Joined 15 years ago
There's a reason they're Anthropic researchers. The value proposition tanks when you actually have to foot the bill for the tokens you use.
Subagent flows can improve overall performance, but it generally also comes with disproportionately high token use. That gets worse with parallel subagents that are often doing the same things at the same time and cannot share a cache.
Even in the optimistic case that this isn't some conspiracy, it highlights how arbitrary their scores are. I had trusted their previous ratings and their new index shows that even AA doesn't agree with them. What's to say this new index is any better and won't just change drastically again?
Though, I realize now the "hundreds of thousands" claim I was responding to is per week, while my guess is all time.
- It has 3.6 million weekly NPM downloads.
- 110k GH stars.
- It's 5th (and its fork is 6th and a dependent is 8th) in monthly Openrouter tokens. Add them all together and they get close to Claude Code numbers.
Edit: https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/blob/...
It's just high school statistics: https://en.wikipedia.org/wiki/Confidence_interval
It's not a probability. It's essentially an assertion that if the test were run 100 times, the result would be within the interval 95 times.
Either that, or the average poster on HN isn't nearly as critical as I had thought.
If that's true, it'd scale linearly with number of bits in the quant with an offset of about 51gigs. So Q4 should be a bit bigger than 82gigs, I'd guess in the 90s (as opposed to a ~280gig q4 if the whole 70gigs of the 1-bit quant scaled linearly).
Generally, for local consumer use, these large MOE models are best for unified RAM systems like DGX Spark or Mac Studio.
As a result, in practice, the only example I can think of is cracks for pirated software.