Comment by scottcha

Hi I'm the CTO of neuralwatt, would love to hear your feedback on what your experience was. Feel free to email me [email protected]. Also for GLM5.2 we run the FP8 quantization at 1M context which is a common deployment target.