hamelsmu
Joined 9 years ago
Karma
370
Submissions
79
Member since
May 10
https://hamel.dev
View on Hacker NewsRecent submissions
Comment · 5 months ago
I'm really excited about this. Looks really handy and well designed.
Comment · 1 year ago
Love it
Comment · 1 year ago
I think that will be very possible soon! We continue to write about it publicly :) Also thanks to my friends and colleagues who write a lot on this subject that I frequently collaborate with:
- Shreya Shankar https://www.sh-reya.com/ - Eugene Yan https://eugeneyan.com/ - Bryan Bischof https://bio.site/Docdonut
Comment · 1 year ago
Appreciate it, Simon! I have now edited my post to include links to "intro to evals" for those not familiar.
Comment · 1 year ago
Hamel here. Thanks so much for asking this question! I will work on adding it to the FAQ. Please keep these coming!
Comment · 1 year ago
This is Hamel. Thanks for sharing! I will incorporate these into the FAQ. I love getting additional questions like this.
Comment · 1 year ago
Really good article. I was discussing this with Shreya (the author), and an interesting insight was that prompting a LLM to follow these instructions do not work reliably.
I’ve had similar frustrations. Maybe the next thing to try is fine tuning? Curious what others think.