N notion.so Kvcached: Virtualized, elastic KV cache for LLM serving on shared GPUs https://github.com/ovg-project/kvcached 69 points Jrxing 1 year ago 13 comments
