letitgo12345

Models that are strong enough to improve themselves without a human (I.e. ai researcher) in the loop

Well there's long term impact but yea that doesn't create enough political pressure to make process efficient

Long codex sessions lead to a lot of cached token hits, esp when you resume them after a few hours.

Can't you execute the bug to see if the vulnerability is real? So you have a perfect filter. Maybe Mythos decided w/o executing but we don't know that.

Worth noting that this is when they used Amazon's own AI product, not when using Claude Code or Codex.

Seems the same tbh

LLMs can use search engines as a tool. One possibility is Google embeds the search query through these embeddings and does retrieval using them and then the retrieved result is pasted into the model's chain of thought (which..unless they have an external memory module in their model, is basically the model's only working memory).

Most straightforward would be to ask the model to generate different evaluation metrics (which they already seem to do) and use each one as one of the dimensions

Or the humans did think of it and were actively proceeding to test that hypothesis

I think the idea for this is anything that can be set in a literal exam for humans. So anything that would take the best human in that topic in the world say more than an hour to complete is out.

Also IIRC 42% of the questions are math related, not memorization of knowledge.

I'm the real world, judges I know are using it to do case summaries that used to take weeks, Goldman is using it to do 95% of IPO filings work and I personally am using O1 pro to write a ton of code.

AI's biggest use cases are for doing actual work, not necessarily replacing regular interactions with your mobile or entertainment devices

Think more is made of this asterix than necessary. Quite possible adding 10x more GPUs would have allowed it to solve it in the time limit.

They found tons of oil

Maybe it is but it's not the only company that is

It's an excellent way of getting your best people who have options to quit while the worst ones who don't are forced to stick around