Comment by TheEzEzz

You're basically taking the model "off policy" when you bias the decoder, which can definitely make weird things happen.