Alright, I have to ask the people here who know about transformers.
What the ... seriously?
How is sentence completion able to generate thoughtful answers to questions? If it goes word by word, or sentence by sentence, how does it generate the structure you ask it (e.g. essay)? There must be something more than just completion. What do the 185 billion parameters encode?
it seems to me, as Stephen Wolfram says, something about our language in the first place, rather than what ChatGPT does.
What the ... seriously?
How is sentence completion able to generate thoughtful answers to questions? If it goes word by word, or sentence by sentence, how does it generate the structure you ask it (e.g. essay)? There must be something more than just completion. What do the 185 billion parameters encode?
it seems to me, as Stephen Wolfram says, something about our language in the first place, rather than what ChatGPT does.