Shekelphile
Joined 3 years ago
Joined 3 years ago
everyone else mostly seems to have just decided to cheat on benchmarks to make their models look better than they actually are, and none seem to want to actually try to make better models.
No other provider is getting the cache hit rates deepseek does or the retention. They use a unique setup that no other provider is bothering to replicate.
> Quantization is not trash, there's a year of evidence that shows Q4 provides ~4% degradation and Q8 provides ~1% degradation, and you don't need that severely quantized to gain benefits in inference performance.
Lol. Quanting at all pretty much neuters a model, just look at how astra performs now compared to at launch.
oai and anthropic also subsidize the hell out of their subs compared to what you will find in smaller competitors, a $20 codex sub gets you like $100-150 usage/wk which goes way further than 2x opencode go (which would only net out to $120 of deepseek 4.1 usage a month, on top of being low performing quantized trash).
Don't really understand people who say DS4 or 4.1 have frontier level performance. Anyone who has used it will tell you that it's a hallucination factory. The only thing it has going for it is deepseek's unique infrastructure that allows better cache retention, but the cost savings from that obviously come nowhere near how much subsidized usage you get out of even a $20 subscription with openai or anthropic.
When they cut prices on luna the first time around they took (literally) millions of users from anthropic.
> Cache hits and refreshes on Claude Opus 5.5 are priced at 0.05x the base input price.
If they do the same for Haiku and Sonnet 5.5 then we should also see 5c/mtok and 10c/mtok cache read for those models, respectively. Still too high for Haiku IMO, Luna is 2c/mtok.
The answer is just a second $20 subscription.
There isn't much compelling reason to use these unless you are just averse to giving money to openai/altman. A $20 codex sub gives you ~$150 of luna use per weekly limit, while there isn't any good subsidized options for chinese models at all (and the few who were subsidizing, like opencode, rugpulled by reducing monthly limit to $60 to $15 with no notice to users).
Deepswe results show that grok 4.6 is more expensive per-task and consistently scores worse than: luna xhigh, glm 5.3, astra low, sol high/xhigh, opus 5 medium.
Grok also used almost 3x as many tokens/turns to complete tasks than all of those models (besides luna), so it takes way more time to complete a task.
There isn't much reason to use Grok at all, it's gotten better but it's still worse than every other player in the field, which shouldn't be a surprise considering until about a year ago they were just buying tokens from other providers and pretending it was their own model.
With gpt-6 luna and sol coming tomorrow it's going to look even worse too, especially if new luna retains the same dirt cheap pricing that 5.6 luna has.