Comment by tehsauce

“A transformer predicts the next token”

Nope. A transformer is much more general than that. A GPT predicts the next token.