Comment Comment by 0-_-0 The kv cache is not discretised, only the output tokens. parent 0-_-0 2 months ago
