CuriouslyC

They're still heavily RL'd on response formatting/clarity, and against common LLM-isms. Long form prose quality is expensive to RL so I expect this to languish for a while until other low hanging fruit has been picked.

If there were economies of scale that enabled it to be more broadly available, and that was competitive in terms of utility gain per dollar invested, why not. IMO the government should be utility maximizing for its citizens, whatever that looks like.

This likely isn't AA putting its finger on the scale for specific interests, rather in the case of Muse/Astra, it's to avoid looking really bad because it scores things way out of wack with people's anecdotal vibes on model capabilities. It is possible that labs are getting preliminary AA results back and raising concerns about scoring that then get folded into updated benchmarks, but I strongly doubt it's nefarious.

Likely they did a distillation run on a later checkpoint of a large internal teacher model, probably with some tuning of the distillation process based on early public results with Argon. RL is the expensive/time consuming step, they should be able to distill down from a checkpoint with the stamp of approval pretty quickly.

Even a decade ago marketing/growth was the massive lion's share. IMO just building something has been near meaningless since at least post-Ruby on Rails. The app stores have been inundated since the late 2010s.

The distinction is adjusted vs non-adjusted basis. Serving inference is profitable, but serving inference for the last released model doesn't cover the cost of the model in training.

Dario explained it very clearly in an older interview. If every model is bigger and more expensive to train, each model can individually be profitable, while the company as a whole still shows a loss at any given point in time. This is why he likes the idea of regulation so much, it'll let them take a breather and recoup.

Prepare for the longest game of hide and go seek in recorded history.

Anthropic cooked with Opus 4.5 and 5.5. Their other iterations have usually been nicer to interact with than GPT and more "autonomous", while being dumber.

Agents are already better at writing strongly typed languages than Ruby, and don't care about the small ergonomic affordances that rails provided. Even if you think the Rails bloat and Ruby nicheness/slowness is worth it today (hard disagree), think forward a year when agents are significantly stronger than they are today and consider how that decision will hold up.

IMO Cloudflare is the closest thing to a "good guy" these days. Very customer friendly, affordable and generally fairly ethical (if you pass over the part where they share data with the NSA).

It's insane to me that people don't see that agents are going to be how you interact with your computer going forward, almost exclusively. The people who make things hard for agents are going to get eviscerated by the people who don't just make it easy for agents to do things, but market primarily to agents rather than humans.

Instagram is trash. Stop wasting your time.

As a Krea2 local model enjoyer, your challenge is that on the $20 GPT plan you get a fairly good amount of Codex use and image gen. If I used Krea, it would be because I fine tuned/built a workflow on top of it to do something GPT image couldn't/wouldn't do. Maybe there's a market for the cheapest "good enough" bulk image gen model (spam? idk what the applications would be), but personally I'd say you should focus on workflow add-ons/one click fine tuning/etc that design companies can use to create assets with their custom "look" since the GPT-Image look will become blase from overuse.

The delta isn't really slower, we're just unlocking capability bundles in batches. The capabilities bundles you care about might have mostly been unlocked already, and just need refinement, which is coming slower than the initial capabilities came, but don't discount the breadth of advances being made across all possible tasks.

Beyond SVG, these things have been RL'd on 3d reconstruction (which carries over), and I expect given the public reaction to recent frontier advancements in 3d capabilities that this will get allocated a larger share of the post training budget in the future.