Comment

Comment by lumost

No, reusing segments of the kv cache for different purposes in an order independent manner is an active research area.
parent lumost 5 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton