Comment by dontlikeyoueith

> We train them for the ability to predict thr next word, which is a task that can only be performed satisfactorily by working at the level of concepts and their relationships, not at the level of words.

This is just obviously, trivially false.