applgo443
Joined 5 years ago
Karma
87
Submissions
68
Member since
Oct 29
Joined 5 years ago
Can we use logprobs of LLM as confidence scores?
Is there a way to use envelope in places like those?
Similar to the prompt engineering for previous era GPT completion models.
And I'm curious to know more about your costs of deployment and running on Modal.
It'd significantly increase the costs though.
If you don't mind me asking, what do you do? I'm a researcher at FAANG working on language models and starting a new company in the space. Would love to connect. Feel free to email me - [email protected]
My email is [email protected]