Comment Comment by kbumsik > performance often degrades under different chat templates, long-context inputs, or out-of-distribution system prompts.I heard that speculative decoding doesn't affect performance (I meant accuracy). Am I wrong about it? parent kbumsik 5 months ago
I heard that speculative decoding doesn't affect performance (I meant accuracy). Am I wrong about it?