Comment by jszymborski

Thanks for flagging, this is on my local rig and it's driving my display too. I'm curious now, will take a closer look. These are the tok/s as reported by LMStudio.

EDIT: Updating llama.ccp gets me 58 tok/s on Gemma 31b