Comment by eliaskg

I wanted to know as well. KV cache is Q8 by default but can be set up at full precision in the config.