Davidzheng

To get to the other side, obviously.

I think anthropic one is edited by humans, OpenAI drop just looks like how Astra writes (i know it's probably a different model producing this but still)

Maybe it's arrogant to say as someone working in pure math but I highly doubt this is the cause

Makes me sad that the homotopical foundation people never got their shit together and now formalization is so mature but it's still done in set theoretic foundations.

they were never meant to stay as manufacturers on the sidelines

I mean, the models (starting with Bel clearly and Astra probably--though Astra probably is worse than top humans in some areas) are superhuman at math.

I don't understand. The AI-math guidance counsel has recently explicitly argued against what you say in paragraph two, and which is why for the Kakeya problem there was no group formed. The different communities have given different suggestions. I'm not sure how much I agree with the first paragraph either given these facts.

I think it should be allowed yes. I don't think our strategy is hoping the agents never learn that misalignment is an option.

The answer, as Noam Brown explained in the Dwarkesh interview, is that it is not emergent at all. They carefully selected reward functions in RL to incentivize cooperation in the last year in order to develop multi-agent systems which are faster and more reliable. However, I guess after it is baked into the model to cooperate, they can sometimes override instructions not to.

I highly doubt this will happen.

depends on what you think shrink means. If you mean decreasing, that's false even eventually.

I have to say, if you looked at the graphs of the last reports, 1.5C was never going to happen.

yeah agreed.

But then you can start with a solution and try to make an understandable one.

Happy to hear that yes! I hope more people do learn about math from this !