Comment by jumpCastle

Also the parameters are optimized also with loss of future tokens in the sequence.