Comment by dchftcs

A bit tough to say this, but transformers are trained the same way.