Comment Comment by cateye Odds Ratio Preference Optimization (ORPO): https://arxiv.org/abs/2403.07691 parent cateye 2 years ago
