Comment Comment by _cs2017_ How is this different from KV caching?(For reference, basic KV caching is explained here: https://www.omrimallis.com/posts/techniques-for-kv-cache-opt....) parent _cs2017_ 2 years ago
(For reference, basic KV caching is explained here: https://www.omrimallis.com/posts/techniques-for-kv-cache-opt....)