Comment by dsrtslnd23

yes would also be interested in that - using knowledge distillation and other special knowledge sources to post-train on top of an open model like GLM-5.3. I was wondering that when Elon Musk tweeted "Specialist AI’s (single language, single area of knowledge) are another 100X" (src: https://x.com/elonmusk/status/2089968914596045178) - maybe he knows something regarding specialist model training the general public does not know?