J jwlabs.vercel.app Predictive Speculative KV Replication for Bursty LLM Inference https://github.com/jwlaboratory/bite-the-bullet 41 points shreybirmiwal 3 months ago 4 comments
