Comment by mmoskal

It updates token logits (probabilities) after every token before sampling. I don't think this is very common yet.