Comment Comment by natrys I think we don't have a good draft model for better speculative decoding yet (e.g. DFlash 2). Once we do, it will be faster. parent natrys 2 months ago