I would be curious to see the end result of letting it endlessly update its inputs from its own outputs. I was under the impression that eventually this would cause delusions and if you let it do this long enough and it is solving problems that no humans can verify as correct that it isn't useful.
Maybe that is the limits of my imagination, but it seems unwise to take humans completely out of the loop. Having mathematicians around that can understand what it is doing so that we can utilize that knowledge in a way that we can have some confidence in seems important.
Maybe that is the limits of my imagination, but it seems unwise to take humans completely out of the loop. Having mathematicians around that can understand what it is doing so that we can utilize that knowledge in a way that we can have some confidence in seems important.