Comment by ggerganov

Better keep the KV cache in full precision