This relies on the idea that AIs will only ever do the thing they just did, and nothing more.
It's the same argument which is invariably wrong yet comes up over and over again.
There's no real reason to think AIs solving lots of problems will stop further work on alternative paths - certainly a machine which never tires and can be trained on its own solutions is going to continue to improve.
There's precedent for this: just look at any overconfident post regarding what China will clearly never be able to do, despite decades of steady if frequently flawed progress.
There's no persuasive argument being presented as to why machine mathematical research should have a limit beyond hardware capabilities.
It's the same argument which is invariably wrong yet comes up over and over again.
There's no real reason to think AIs solving lots of problems will stop further work on alternative paths - certainly a machine which never tires and can be trained on its own solutions is going to continue to improve.
There's precedent for this: just look at any overconfident post regarding what China will clearly never be able to do, despite decades of steady if frequently flawed progress.
There's no persuasive argument being presented as to why machine mathematical research should have a limit beyond hardware capabilities.