Comment by zackwu

Is it surprising? Let's face it - distillation is common practice and every lab does it either intentionally or unintentionally (your training corpus always includes AI generated content in the post ChatGPT era).