Comment by jstummbillig

If you are distilling from other models (according to Anthropic reports they are [1]), there are probably a bunch of things that you can just do away with.

[1] https://www.anthropic.com/news/detecting-and-preventing-dist...