Comment by moktonar

Finally I start to see what will save the situation: you can only advance AI up to your highest level of intelligence, after that you start losing control and thus cannot reliably advance. That’s the mechanism that will make AI development viable. It won’t be improving exponentially, instead it will improve at the rate our intelligence can. This is both reassuring and a very good example of how co-evolution works. Expect an s-curve soon, but also this is the moment where we as humanity will start benefiting.