Comment by prempv

I've had the same experience as well. I suspect if it's due to large presence of HTML in the training data as part of codebases and online content