Comment by xenonite

great to hear, which quant + KV quant + KV size are you on? is it llama.cpp?