> What if I specifically tell it to not do anything nefarious or illegal?
Sure, but a reasonable user would expect that condition to be implicit in using a commercial model.
It’s what the safety/alignment discussion is about: how we can get models to actually comply with laws & ethics.
But the same problem exists in the real world. If you tell someone to “Try everything possible to get it done, I don’t care what it takes”, I’d imagine that people would be far more likely to bend/break rules than if you said “could you please help me with… ?”
Sure, but a reasonable user would expect that condition to be implicit in using a commercial model.
It’s what the safety/alignment discussion is about: how we can get models to actually comply with laws & ethics.
But the same problem exists in the real world. If you tell someone to “Try everything possible to get it done, I don’t care what it takes”, I’d imagine that people would be far more likely to bend/break rules than if you said “could you please help me with… ?”