Comment

Comment by crvdgc

For the sake of argument, let's assume everything in the post is agreed upon, does this mean

1. They'll open source the alignment technology? For open weight models, it's the only possible way to pass the safety without an external guardrail triggering system (which would be the same to open and closed weight models).

2. They'll allow others (including CCP) to define part of the safety test? Otherwise, I can't imagine how the CCP would be onboard.

3. A "western" model passing the safety test can be trained with distillation? Or is that a "distillation attack" as well?

parent crvdgc 3 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton