Comment by pu_pe

So much faster inference with no quality degradation? All that for just some small memory overhead (drafter models are <1B it seems)?