Comment Comment by octoberfranklin Yeah unfortunately the confabulations are the real problem with models of this size.IMHO you need at least 500B weights before the confabulation problem is really under control. i.e. DeepSeek 4.1 or GLM.I admit some days I'm just lazy and throw a whole Kimi or QwenMax at it. parent octoberfranklin 16 days ago
IMHO you need at least 500B weights before the confabulation problem is really under control. i.e. DeepSeek 4.1 or GLM.
I admit some days I'm just lazy and throw a whole Kimi or QwenMax at it.