Comment

Comment by inkblotuniverse

Evil is the wrong term. It's not that an AI will 'turn evil' - it's that we don't know how to make a 'good/friendly' AI, by which I mean an AI that inherently values humans and the things humans value, and any optimising agent that isn't 'friendly' in this sense has an incentive to use our atoms to fulfill whatever it does care about.

This won't be a perfect analogy, because humans have empathy (even towards ants) because we're mammals etc., but how many anthills have humans gassed because the ants were an annoyance?

Now imagine if ants could build nukes- or humans!

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton