Comment by urbsgpw

Haven't been following the articles and snippets we get from these labs about training their models for a while. But I'm guessing the latest chinese models are way less based on distilling? If not, then your speed of progress is still limited by the two labs (which we are collectively, in various forms subsidizing).