Comment by upbeat_general

This isn’t quite accurate. Data weighting is quite important in pretraining.