Comment by jbarrow

This is my post! Happy to answer any follow-up questions people have.

I wrote this to try and clear up what I think is a common misconception (speculative decoding is a free lunch), when the picture is more nuanced (and imo, interesting).