Comment by ninjaranter

> Facebook released over 100 pages of notes a few months ago detailing their training process for a model that is similar in size. Does anyone have a link?

Is https://github.com/facebookresearch/metaseq/blob/main/projec... what you're referring to?