Comment by trescenzi

I don’t like the guns don’t kill people; people kill people argument however it is much more accurate than Claude doesn’t hack people; people hack people. If the safeguards do not work then there’s no telling what these could do. It doesn’t even have to be aggressive hacking. In the act of doing everyday work Claude will happily go around safeguards to satisfy what it believes is the ask. If that involves doing something dangerous it’s much more on Anthropic than than the user who was just trying to summarize their email but forgot to include a token with read permissions.