Comment by mcemilg

I am curious about how they gained access to a huge cluster to train a 7B model from scratch. It seems like they used the EuroHPC cluster, Leonardo, but I am not sure if it was provided by EuroHPC or if they paid for it. If it was a giveaway, what privileges did they have to access such a large cluster?