Comment

Comment by yorwba

Without anchoring on the group average it's hardly Group-Relative and without likelihood there's no Policy; that doesn't leave much of the original GRPO unchanged...

Do you have a particular paper in mind that does likelihood-free best-of-K but just calls it GRPO?

parent yorwba 3 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton