I remember those days and I'm glad to see another one who's been in the industry since the very beginning :) I was quite sad when davinci-003 was taken away; still remember the green-yellow-orange-red highlights the OpenAI console would make for log probabilities of tokens and all the cool things we could do with a pretrained model.
In my courses, I teach students about that era by using gemma 4 (pretrained) and showing how you can emulate a conversation even on something that wasn't post-trained for chat.
In my courses, I teach students about that era by using gemma 4 (pretrained) and showing how you can emulate a conversation even on something that wasn't post-trained for chat.