Comment by sabareesh

Sounds like speculative decoding but for KV cache