Comment by zeroxfe

Distillation does not require access to weights.