Comment by liuliu

KV cache shifting is interesting!

Just curious: how much of your code nowadays completed by LLM?