Comment by sujayakar

Deepseek is already using SSDs for their KV cache: https://github.com/deepseek-ai/3FS