Comment by DreamGen

A big distinction is that you can built on top (fine-tune) thus released models as well as if they released the pre-training data.