pietz

I can literally see what the training data sample looked like that they included, so it performs well on this benchmark.

This was lovely. Can we have more of this style of communication?

Or, you know, it's an easy excuse because they're already behind on many of them.

I'm open to Google winning me over again, but there isn't enough hype in the world to do it. They will need to earn it after these disappointing 6 months.

Aren't they? Not about 4.1 Flash but open weight models in general.

The fight between Anthropic and OpenAI is just about who leads the duopoly. Chinese open weight models are threatening a duopoly in its entirety. That's why Ant and OAI are begging for regulation. A regulation that will hit Chinese models way harder than US models, finally giving them a moat.

Any open weights model is "on prem".

I mean no disrespect but these are terrible numbers or am I missing something? It seems like Mistral continues to only be relevant for people that want a model trained in Europe. Too bad.

This should have been a prompt.

I know companies benchmaxx, but after what Google pulled with Gemini 3.8 Flash, I give zero f*cks about any numbers they report. No other model on Artificial Analysis dropped harder after they adjusted their weighting. Just look at their DeepSWE scores and then try to do any serious coding with the model.

Google is desperate. They haven't been performing in half a year. It's clear their researchers have been forced to integrate existing benchmarks into their training.

These numbers are meaningless. Shame on them.

In all fairness though, OpenAIs $200 plan was actually 20x compared to Plus, whereas Anthropic pulled this shady wording where it's only your session limit that is 20x while your weekly is only 10x.

But yeah, weird timing after a meh release and their competitor killing it right now.

Companies like OpenAI or Anthropic could offer it basically for free as an extension to their existing models. You still need the generator, but having something fast (and maybe even local) to do browser nav would be awesome.

In all fairness, this would be one of the better use cases of Jev I've seen.

Apparently I have a new favorite benchmark. Honestly, this is cool.

I'm surprised something like Jev came out "so late", but the hype has been ridiculous. Yes, it's a good idea. No, it only helps when fast and cheap are important and I guarantee existing labs will have this figured out in a matter of days.

Add visual understanding, add reasoning and bring down the size to run on my computer. That's when it will be interesting.

So many people that don't understand the tech jumped on the hype train because "it cannot hallucinate" and else. It's crazy.

Wow, this couldn't have been written at a worse time. OP absolutely doesn't know what he's talking about.