saretup

That was spot on.

Behind the scenes probably went something like this:

CEO: We are gonna miss our earnings by a lot. What’s the best internal model we got?

Tired AI Engineer: Doesn’t have a name but here it is.

CEO: Is it frontier on AA at least?

Tired AI Engineer: No?

CEO: Fucking hell. Tell AA guys I’ll pay them 10 mill if they change the methodology to show our unreleased model as frontier.

Legal Team: On it.

48 for GPT-6.1 Terra Max vs 58 for Opus 5.5 Max on AA Index

I’m sure once this category has traction and investments coming there will be open source models too.

> Facebook once literally asked for nudes

I’m sorry, what?

Curious as to why. Haiku 4.5 has been far away from pareto frontier for a long time. Maybe you need to update your prompt for the newer model in your workflow.

To be fair, you're making it compete with the best public LLM right now that's 2 size/price tiers above it.

> It was 'fun' at the start, now it's just 'broken technology'.

It was even more 'broken' at the start. We overcame some of the issues by 'prompt engineering', which is needed less in the newer, smarter models.

Not that this benchmark is super relevant anymore but these look worse than I expected.

Now that it's a solved benchmark, can we get the 3d animated version?

Are they? Looked correct to me. At high enough speeds even real ones can look rotating either way in videos depending on fps.

It’s an additional layer of wall for their walled garden to keep the technically proficient users that are more likely to hop walls.