Comment by amai

Isn't that just an artifact caused by the tokenization of the training and input data?

See

https://platform.openai.com/tokenizer

https://github.com/openai/tiktoken