Comment Comment by verdverm 1. Everyone has been doing distillation for a long time2. You ideally want outputs from multiple models, not a single one3. Distillation (or a model trace) is insufficient on its own (a) you need a sufficiently strong base (b) crafting RL rewards is an art4. You are conflating DeepSeek with Moonshot (K3) parent verdverm 3 months ago
2. You ideally want outputs from multiple models, not a single one
3. Distillation (or a model trace) is insufficient on its own (a) you need a sufficiently strong base (b) crafting RL rewards is an art
4. You are conflating DeepSeek with Moonshot (K3)