unrvl22

you are a joke if you think omp is a joke.

someone screenshot?

their sub is crap. use opencode go (multiple workspaces) or wait for weights to drop

which is the bigger headline that people don't realize. this is 744b and its head to head with Kimi K3 (2.8T), smashes DS v4 pro (1.5T). even Opus and Sol are rumored to be 1.5T+ this is half the size!

I was thinking the same thing. It feels truthful, no marketing BS and they call out where they lack behind the best models

its kinda crazy with literally no guardrails and a goal, the extremes these AI models can actually go to.

a good take.

Something like this is nice, where instead of having 1 model with X active experts, you have 10 different models, all small and dense, trained on specific information. and loaded on 10 different servers, with one router.

inference is only memory bandwidth limited when targeting higher tps / high single stream tps. the weights only need to be moved across once per forward pass, when you batch say 100 streams per forward pass (which is what most inference services do / care about) its compute bottlenecked.

that 213 wasn't achieved when saturated though. was probably more like 30 tps per stream when doing 2.6k tps.

MI355X can perform FP6 operations with the same speed as their FP4 (unique to AMD) - people should be making MXFP6 quants which would be pretty much lossless, and much closer to FP4 performance than FP8

look at benchmarks, use the model yourself. Im usually first to call BS on every chinese model that says they are as good as Opus. this is finally the first one that actually is. It is a massive jump from every other previous chinese model.

the 2 I mentioned both have a fairly large following, who run benchmarks and absolutely will spot issues.

I cancelled my claude sub after realizing I can burn 300m tokens a day of this quality, for $50 a month.

Why aren't more people talking about this? It's literally Opus 4.7 quality stupid prices. I know providers who are offering this at unlimited tokens for $50 a month. Some are even offering API rates at 3x lower than the official ZAI api rates which are already like 10x cheaper than Opus. (Crof and Umans btw)

This is a huge blow to Anthropic/OpenAI/Google and a massive win for the rest of the world. The official API prices and speeds mean nothing for open source models.