Comment Comment by lumost No, reusing segments of the kv cache for different purposes in an order independent manner is an active research area. parent lumost 5 months ago