Comment by knuthsat

Tools for exploring the models are already being developed.

Language models that are not given concepts of part-of-speech, dependency trees, grammars, develop representations of their own and people have found ways to inspect them.