Comment

Comment by nonethewiser

Why arent there laws against being cruel to spoons?

>There is just no ethical argument

Utilitarian harm reduction: Psychological Discharge is a psychological framework that argues safely simulating negative behaviors can help someone process or discharge them without real world harm.

Research and misunderstanding: Sending a prompt that is interpreted as cruel does not mean the person is being cruel.

Expending compute is irrelevant in terms of morality. It's an economic or environmental question. Either being cruel to AI is bad or its not - being cruel is not bad because it uses tokens.

The worst thing here is Anthropic continues to say they are concerned with "alignment" but then continue to train their models to ignore the user. Software typically does what the user requests. But we now live in an age where the software may do what the user requests or it may do something else, and we're suppose to laude this as safe and responsible.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton