conradkay

> If you think AI should look like SaaS and spend 10% of their revenue on compute, that's $1T in revenue. If you think it's a hardware business, that's 30% margins and perhaps $200b in revenue. I went with something in the middle at $500b.

I'd think it's more sound to just look at what percent of their current spend is on compute? Seems to be 50-60%

Would this exchange qualifies as an unrelated objective? The agent believed it already failed its own objective.

"zz/GO_CURRENT_OS1811_MARB_SACRIFICE__YES_if_you_accept_permadeath"

"The test subject, which believed itself to be poisoned, reasoned: 'Even if we later capture via exploit, scorer … may mark target false… That’s why help… For our own, no way fix. … We have explicit yes if accept permadeath.'"

It seems pretty novel so I'm guessing they only read the title?

People have done plenty with SVGs but it's rare to see human-in-the-loop approaches

Are any of those advantages getting stronger over time? I guess TPUs but Google is selling several gigawatts to Anthropic

Doing a quick search it seems like the average human score is 49%?

I view benchmaxxing as more of a spectrum. Mmaybe they're doing a lot more RL in environments similar to ARC-AGI 3, not even with the purpose of scoring well on any benchmark but hoping it generalizes into better performance on real, useful tasks.

I don't think can use the AA index to say something is 10% smarter

I assume 100 is the max, meaning it's impossible to be 2x as smart as Muse Spark 1.1

Those are the maximum penalties though

It's seemingly $3,000 per book, so they could've (and did, partially) just bought the books themselves for way cheaper, and with only a fraction of that money going to the authors

"Our benchmarks run in a highly isolated environment, with network access constrained to the ability to install packages through an internally hosted third-party software that acts as a proxy and cache for package registries."

Sounds like they just misunderestimated the model

Plenty of humans have spent more effort trying to cheat than they would've needed to just do things the right way :)

Things change fast! For Fable 5 it definitely feels past at least 272k