Yup, one output token, and read the logprobs of the posible tokens that could have been thos 1st token. Plenty of systems already do this; Typesafe's fundraising and marketing just made it visible.
Good to see interest broadening beyond "just extend thinking." More approaches in the toolbox means fewer problems get treated as nails.
Good to see interest broadening beyond "just extend thinking." More approaches in the toolbox means fewer problems get treated as nails.