One takeaway from this is that anthropic do not want their public-facing model to be good at advanced ML research.
With that incentive it seems reasonable to assume that future anthropic models will not be good at ML research, at least because they aren't incentivised to make it so, and therefore using other models perhaps open source will be the way to go.
This does make the large assumption that they can afford to train a parallel model for themselves to assist in their own research. But given their huge valuation, and incentives, that extra cost is feasibly worth it for them.
With that incentive it seems reasonable to assume that future anthropic models will not be good at ML research, at least because they aren't incentivised to make it so, and therefore using other models perhaps open source will be the way to go.
This does make the large assumption that they can afford to train a parallel model for themselves to assist in their own research. But given their huge valuation, and incentives, that extra cost is feasibly worth it for them.