Comment by nafizh

check out cs 336 stanford, they cover DPO/GRPO and relevant parts needed to train LLMs.