Comment by nharada

The logbook is awesome: https://github.com/facebookresearch/metaseq/blob/main/projec...

This is the true secret sauce -- all the tricks on how to get these things to train properly that aren't really published.