Ask HN: Why aren't brilliant people even a little bit afraid of AI alignment?
I love this quote: "Imagine the unfriendly AI wakes up and decides it needs to (a) start a cult that promotes human extinction and technological development at all costs, and hack our social systems to make that the cool thing to be (b) recruit the most powerful people in the world to prevent it from being shut down"
I can understand not being a "doomer" and I even myself want to keep going with AI as is and reject Eliezer Yudkowsky's plea to stop, but what I don't understand is why aren't more brilliant people even a little bit conflicted about this? It seems if you even hint you have some doubts and say well, maybe 1% chance Eliezer is right you are told NO, it's not even 1%. It's 0%!
I can understand not being a "doomer" and I even myself want to keep going with AI as is and reject Eliezer Yudkowsky's plea to stop, but what I don't understand is why aren't more brilliant people even a little bit conflicted about this? It seems if you even hint you have some doubts and say well, maybe 1% chance Eliezer is right you are told NO, it's not even 1%. It's 0%!