What happens when we have proofs that are too long for a human to understand, and only the llm can spend the perhaps years of human effort to verify things? That will happen.
With humans we break things down (proofs, new concepts) into digestible hunks for each other, because you want other people to understand them but also verify them. And it's less common for someone to build a tower of new intellectual things with 1,000 new connected ideas that prove things and build up together, that ends with P = NP after all or something.
So since we have these new tools that can chain things together more than we can, eventually there will be huge "proofs" where there are long chains of new ideas, concepts used to build up ever more in giant intellectual towers. And we can't verify/understand them, at least not for many many years.
I shudder to think of such a situation. We already have very important ideas that have no proofs, that people build on. Now build 100s of these things together.
With humans we break things down (proofs, new concepts) into digestible hunks for each other, because you want other people to understand them but also verify them. And it's less common for someone to build a tower of new intellectual things with 1,000 new connected ideas that prove things and build up together, that ends with P = NP after all or something.
So since we have these new tools that can chain things together more than we can, eventually there will be huge "proofs" where there are long chains of new ideas, concepts used to build up ever more in giant intellectual towers. And we can't verify/understand them, at least not for many many years.
I shudder to think of such a situation. We already have very important ideas that have no proofs, that people build on. Now build 100s of these things together.