Comment by anuarsh

We are talking about 100k context here. 20k would be much faster, but you won't need KVCache offloading for it