Some humans are likely to become more powerful than other humans some day. Most such humans will by default develop instrumental subgoals that conflict with other human interests. This could have catastrophic consequences. If we don't actively work on control mechanisms and safety of human behavior, this will most likely pose an existential risk to humanity.
Compare and contrast.
I think people make too much of the wrong things in the matter of general artificial intelligence.
Compare and contrast.
I think people make too much of the wrong things in the matter of general artificial intelligence.