Comment by undeveloper

distillation results in a worse product than the actual teacher model iirc