K0IN
Joined 6 years ago
Karma
197
Submissions
138
Member since
Sep 5
[email protected]
View on Hacker NewsJoined 6 years ago
also "i just want to edit a config file and i want a nice ui", is how you get there.
Since most chat models want to answer with a human-readable message i think their logprobs are not as meaningful. It would be interesting to see if one choice is like "correct" and if the model wants to choose it more often, cause it might not answer the question but to prose to the user.
(ofc. I see only the ppl who need this kind of service so I'm biased, and maybe it's not a wide spread issue)