Comment Comment by colingauvin Pretty much just this, but tweaked to have I think 64 active conversations be cacheable, which drops the context pool to ~2M.https://github.com/MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Spark...I also had to downclock my Sparks (Asus) slightly, to 2000 Mhz. Otherwise they'd overheat and crash. parent colingauvin 15 days ago
https://github.com/MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Spark...
I also had to downclock my Sparks (Asus) slightly, to 2000 Mhz. Otherwise they'd overheat and crash.