Comment

Comment by Quarrelsome

I would suggest that a big part of avoiding abuse is that it leads to unexpected output. Given a model reflects its inputs, I imagine that abuse leads to unstable output as the model might then seek victim behaviours to better reflect the input.

Often abuse comes from a bad place anyway. As the programming meme goes:

> do what I want, not what I said

which can create horrific alignment issues with conflicting demands.

parent Quarrelsome 27 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton