Comment by TrevorJ

Sure it does, if those tokens appear in the training data.