Comment by qingdao99

> But once one exists you can use it to make more relatively cheaply by generating training data.

Is that a real technique? Why not just shrink down the model itself directly somehow, is that not possible?