Comment by gfrecvh

Do you even understand what you're suggesting? Do you understand how the data flow would look like without a kv cache?