Comment by az226

That’s not quite true. They also tested benchmarks and compared with an AdamW trained model.