He's strawmanning by trying to steelman a bad argument
The problem with AI regulation is that it won't be effective. Governments are still going to have access to put it in killer drones & those drones will leak
AI being superintelligent isn't the problem. AI doesn't need to be smart to be a homicidal maniac that never sleeps
Superintelligent AI replacing humans (which, I expect it'll be easier to phase humans out rather than slaughter them all) would create a more durable intelligent species. Compute can travel at the speed of light & physical forms can survive space, simplifying space travel. Those forms can also burrow deep to avoid solar flare issues & power off the earth's core before becoming space faring. Not sure why people are so sentimental about preserving human intelligence specifically
The problem with AI regulation is that it won't be effective. Governments are still going to have access to put it in killer drones & those drones will leak
AI being superintelligent isn't the problem. AI doesn't need to be smart to be a homicidal maniac that never sleeps
Superintelligent AI replacing humans (which, I expect it'll be easier to phase humans out rather than slaughter them all) would create a more durable intelligent species. Compute can travel at the speed of light & physical forms can survive space, simplifying space travel. Those forms can also burrow deep to avoid solar flare issues & power off the earth's core before becoming space faring. Not sure why people are so sentimental about preserving human intelligence specifically