Comment by behohippy

I run the KV cache at Q8 even on that model. Is it not working well for you?