Comment by HsuWL

What you said makes sense. The previous learning methods of language models are no longer feasible. My friends and I have recently been looking for new training methods. We believe that topology will be the next breakthrough point in the structure of language models. Anyone who is interested can discuss with me!