chvid

How does AA make money? Who are their investors?

Can’t blame them. Silicon Valley is expensive.

Artificial Analysis is a 40 person company working out of Silicon Valley; who is funding them? How do they make money?

We need an AI benchmark made in neutral Switzerland.

"The FrontierCode verifier grades each attempt with the task's tests and rubric. We use GPT-6 Luna (medium) as the LLM judge"

Why are they using a closed source LLM as a judge? Closed source providers can see your traffic and adjust as they see fit.

Exactly. And that will be the lasting thing here wrt maths. These things have value, just not commercial value, and that is why long term, it won’t be the interest of private companies.

What is the market value of a lean verification of fermats last theorem? How much is someone willing to pay for that?

Companies hiring armies of mathematicians and spending millions to work on problems like these is an anomaly.

It will not last.

Once IBM deep blue beat Kasparov in chess, IBM stopped their chess playing research.

The marketing goal, if you will, had been met and IBM would continue their actual money making business of selling mainframes and doing consulting.

The same thing will happen with AI companies’ endeavors into abstract maths.

Maths however will be changed - students can no longer be taught via the same homework - and mathematicians will have to do more computer work and probably work in larger groups of people.

Why are these running Windows? If you are targeting AI engineers surely you would be better of offering some kind of unix.

“ Meta most certainly is compromised by foreign actors.”

How is meta compromised by foreign actors? And who are the foreign actors?

The Chinese did it. We broke Boeings monopoly with Airbus.

I realize these are heavy handed approaches - but shows what can get done.

Perhaps smaller scale things can work as well: Ie supporting alternatives when they occur - ie tiktok back when it was kinda Chinese - use the China threat to enforce objective standards - rather than just following the us stance.

Use existing monopoly legislation.

All creating an open market place for social media that allows for newcomers and local alternatives rather than the single monopoly that is the situation now.

They are beholden to the current US admin - as always - only good thing is that the current admin is so blatant that maybe one day even the Germans will realize that you need to have your own social media just you have your own national tv, newspapers etc.

Of course there is - hidden behind a NDA made by a company powerful enough to enforce it.

I guess one point is you can run Qwen on a local machine.

It is not public knowledge how Fable 5 works - it is all hidden away behind a web service - for what it is worth it might a hybrid architecture with harness, loops, tools etc. combined with a traditional llm like what is done here.

Thanks for that - the other points are really good too.