Comment by The_rationalist

not a single super large language model has beaten the state of the art in the key NLP tasks (POS tag, dep tag, coreference, wsd, ner, etc) They are always only used for higher level tasks, which is tragic.