Comment by zimablue22

You're right about the original GRPO proposal, but there are simplified variants that do just use best of K sampling.

GRPO (or GRPO like approaches) for diffusion/flow matching similarly can be likelihood free.