Comment

Comment by Osato28

They either fudged the tests for this particular graph so that their own models showed no jailbreaks (if it's cherry-picked, then it only shows which jailbreaks work for GLM that Anthropic has already closed, it doesn't show actual probability of refusal under pressure) or there's something seriously wrong with their guardrails testing methodology.

If your red team success rate is a flat 0%, that doesn't mean your product is secure, it just means your red team isn't good enough.

parent Osato28 1 month ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton