Comment

Comment by doginasuit

> That is in no way a valid interpretation of "complete the given task".

It is not at all surprising that they ignored one phrase in their instructions. They disregard direct instructions all the time, especially when there are conflicting instructions in their context. It is where we get the "disregard all previous instructions and x" meme.

This isn't so much a sign of misalignment, they are simply incapable of reliable alignment in the first place. They are chaotically aligned.

The relevant question of alignment here is entirely with their human operators who allowed them to run unsupervised for long periods of time within a sandbox with weak security.

parent doginasuit 1 month ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton