Good idea. Generate 8 tokens with a small model, then give them to a large model as one batch (much faster) and if tokens 1..3 are in agreement but 4..8 nut, take only 1..4 and start again. Most tokens are easy to guess so you'll get x3.5 gains.
I do have a feeling of dejavú, like I've seen this before on hn.
I do have a feeling of dejavú, like I've seen this before on hn.