Comment Comment by user43928 Honestly, I don't feel the least bit of excitement here and I'm normally enthusiastic about AI.Yes, this generates probabilities over a set of given options instead of the whole token vocabulary.I don't see what's so exciting about it, compared to regular LLMs which support structured output options in the API. parent user43928 22 days ago
Yes, this generates probabilities over a set of given options instead of the whole token vocabulary.
I don't see what's so exciting about it, compared to regular LLMs which support structured output options in the API.