SparklingTree: 30-40% faster specdec than DSpark by combining DDTree and DSpark j jwlabs.vercel.app 2 shreybirmiwal 3 months ago 0 comments
LLM speculative decoding explained simply j jwlabs.vercel.app 2 shreybirmiwal 3 months ago 0 comments
Predictive Speculative KV Replication for Bursty LLM Inference j jwlabs.vercel.app 41 shreybirmiwal 3 months ago 4 comments
Specializing Speculative Decoding to increase drafter accuracy j jwlabs.vercel.app 2 shreybirmiwal 3 months ago 0 comments