crimsoneer

I think the problem is up to date knowledge isn't really the difficult or useful bit. We're sort of moving to a world where the real value in training comes from tool calling and performance over long context - your models shouldn't really be relying on their internal knowledge, but instead calling various tools. But the performance gap between now and six months for that is pretty huge.

Oh, I'd missed this, that's a shame! But yeah, Inkling + Reflection are properly open and quite good.

Inkling, Nemotron Super, Beam Reflection (and of course Kimi, Qwen, etc)

I think this is a quite optimistic view... releasing a SOTA model is a collosal capital investment, and unlike free software, it's not iterative - you can't make a small model and improve it one step at a time, you need to risk the whole load of cash, expertise and GPU time up front.

It's only happening now because labs have bucket tons of VC cash to burn and need a big public flex to raise more cash, or because they're subsidised by the Chinese government. I'm not massively confident either of those will stay true forever.

> it's already known that their model is very likely trained on input gathered from scientists which use OpenAI as a tool for their research

Is this actually known or just broadly suspected? I could never quite figure it out...

This is just straight up, verifiably not true.

For the same reason every single open weight models gets released: it's a big flex and gets investors and developers excited.

Is it a sustainable model? Not really. Will it all blow up in our faces eventually? Maybe. But frankly, releasing code like this is far, far more sustainable than releasing whole models.

Honestly, I hate to tell you this, but the Germans have a whole track record of this fascism malarkey. I'm sure Vlad is pleased as punch, and definitely nudging it along, but if the influence was quite so impactive it would also be a lot more visible.

It's releasing open source code. This is a good thing for the world, even if it impacts the portfolio of US VCs.

But when is another open weights release coming out...

This is how science is meant to work.