Comment by mmonaghan

I think distillation is inevitable and pretty hard to prevent but I also dunno why anyone would spend billions to train frontier models if there's enough distillation going on to get near it with much lower spend.