justapassenger
Joined 10 years ago
Joined 10 years ago
It’s whether you absolutely need the latest capabilities (at the cost of very high prices, sending your data to them, and being totally at the whim of 2 companies, that can shut you off anytime for any reason).
With how good LLMs are already, there’s tons of tasks where not being at the absolute bleeding edge doesn’t matter, especially when you add cost/freedom/supply chain risk/not leaking your data.
Even more - there’s increasing number of companies that give you ability to post train open weight model yourself, for your own use case. Given how many of the gains today are from post training, if you post train it for your specific use case, you’re very likely get model that you own, that works for you as good as frontier, at the fraction of the cost.
That’s not something for an average Joe to do, but for any bigger business with big spent it’s only natural thing to look into. Just one example - cursor composer - that’s fine tuned kimi.
It’s not whether frontier labs will stop releasing models. It’s whether they can generate enough profit out of them. 2 years ago (even 1) they basically had monopoly and combined with demand explosion as capabilities exploded - valuations grew to insane levels. But math now looks different - they no longer have monopoly.
10 years ago it was super hard to have usable “frontier” ML. You needed very complex data warehouse, feature engineers, feature stores, multi level ranking, calibrations, tons of different model architectures, etc, etc. Each by itself was extremely hard engineering problem and really only handful of companies could deal with that complexity.
With LLMs, 95% of that is gone, infra to support them is greatly simplified. Of course, to make really reliable, performant, user friendly, etc - you still need to a lot of engineering. But it’s very different challenge.
LLMs are still surprisingly “easy”. You need maybe a couple dozens of right people, a lot of good quality data and a lot of GPU that you know how to operate. There’s relatively little “secret sauce” needed.
You cannot just put more satellites on top of cities, as they aren’t geostationary (which is why they’re fast), so you need to add insane amount of satellites, that would do nothing most of the time, when they’re not on top of densely populated area.
On top of that, their claims it’s profitable does some heavy lifting with how to account for the cost of launching rockets.
It’s extremely cool product and very useful for many customers. But sustainability of current pricing is very questionable.
There’s nothing fundamentally wrong with distillation.
- to take as my personal device when I travel
- do personal stuff when my corporate laptop is connected to my home setup and constant switching between computers is a hassle (even with a built in kvm in a monitor). i know, 1st world problems
It has a price point that makes it no brainer for me.
1. She stopped making money for rich people.
2. She herself wasn’t rich enough.
Leon is too rich, and he keeps on making money for the right people.