Comment Comment by pornel RAM needed for keeping KV cache around may be the more expensive factor. parent pornel 3 months ago
