Comment by NortySpock

If I was in Anthropic's shoes, I'd definitely have a small team running various open-weight models to distill them for a few billion tokens worth of training data.