Comment by Rudybega

Tokens don't need to represent text.

They are sequence to sequence models.