Comment by Kubuxu

It might be faster to burn the compute instead of having to fetch the KV-cache over the network from an SSD.