Not only Anthropic but any LLM that refuses to produce an answer because of some objection.
I know that no company want to be associated with a headline that their model was used to {something}.
Instead of helping us better learn something, we're heading (in fast pace) to the world where we won't be free to think outside allowed topics.
Example: I asked some LLM to give me the spell (from a certain religion) to bring justice to someone. It refused as it would be "too powerful and could be use to cause damage".
I know that no company want to be associated with a headline that their model was used to {something}.
Instead of helping us better learn something, we're heading (in fast pace) to the world where we won't be free to think outside allowed topics.
Example: I asked some LLM to give me the spell (from a certain religion) to bring justice to someone. It refused as it would be "too powerful and could be use to cause damage".