Comment by cubefox

I don't think such penalties were applied to GPT-2 or even GPT-3, yet they weren't repetitive like that.