Comment by langs

You need to optimize the KVCache part(save to disk to save compute) to achieve this goal.