Comment

Comment by padolsey

Considering its corpus, to me it makes almost no sense for it to be more helpful when offered a tip. One must imagine the conversation like a forum thread, since that’s the type of internet content GPT has been trained on. Offering another forum user a tip isn’t going to yield a longer response. Probably just confusion. In fact, linguistically, tipping for information would be seen as colloquially dismissive, like “oh here’s a tip, good job lol”. Instead, though, I’ve observed that GPT responses improve when you insinuate that it is in a situation where dense or detailed information is required. Basically: asking it for the opposite of ELI5. Or telling it it’s a PhD computer scientist. Or telling it that the code it provides will be executed directly by you locally, so it can’t just skip stuff. Essentially we must build a kind of contextual story in each conversation which slightly orients GPT to a more helpful response. See how the SYSTEM prompts are constructed, and follow in suit. And keep in the back of your mind that it’s just a more powerful version than GPT2 and Davinci and all those old models… a “what comes next” machine built off all human prose. Always consider the material it has learned from.
parent padolsey 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton