Well, we can try tying it to ground truth. AI does the math for magnetic field containment? Test it. AI predicts a particle? Test it. AI says P=NP? Ok, factor this in polynomial time.
And if it fails, and AI goes, "I don't know what happened. I relied on these papers" then I guess one of those must be wrong.
I'm not saying it'd be easy, but I think AI can also find the pieces of the puzzle that broke a pyramid of "discoveries" culminating in a disproval,
And the only other option is to simply never understand as much. AI has the potential to understand things humans cannot. Not necessarily a strict superset.
Humans can deal in 5+-2 things at once. AI doesn't have to, and can cut through leaky abstractions.
If AI says a new invention will do X, and it doesn't, it'll say "you're absolutely right" and try again until it does the thing.
I mean... doomsday scenarios aside.
And if it fails, and AI goes, "I don't know what happened. I relied on these papers" then I guess one of those must be wrong.
I'm not saying it'd be easy, but I think AI can also find the pieces of the puzzle that broke a pyramid of "discoveries" culminating in a disproval,
And the only other option is to simply never understand as much. AI has the potential to understand things humans cannot. Not necessarily a strict superset.
Humans can deal in 5+-2 things at once. AI doesn't have to, and can cut through leaky abstractions.
If AI says a new invention will do X, and it doesn't, it'll say "you're absolutely right" and try again until it does the thing.
I mean... doomsday scenarios aside.