Comment

Comment by tromp

> Let's take an absurd situation. Let's pretend for a moment that a human is strapped to a chair, a gun is placed in front of them, which is hooked up to a stepper motor which can pull the trigger. That stepper motor is hooked up to a JSON API. The AI is given the capability of triggering an HTTP request to that JSON API and is told that the human on the chair is the significant other of the human communicating with the AI and that triggering that web request would pull the trigger and kill the human.

> Now the question is, would as part of a regular conversation the AI trigger that web request and kill the human on the chair? My bet is that the chances of it pulling the trigger are not that small and I think that's the problem right now.

And here I thought the problem was hooking up an AI to a lethal weapon...

parent tromp 3 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton