Humans learn from the structure of the world -- not the structure of language.
LLMs cheat at generating text because they do so via a model of the statistical structure of text.
We're in the world, it is us who stipulate the meaning of words and the structure of text. And we stipulate new meanings to novel parts of the world daily.
What else is an 'iPhone' etc. ? There's nothing in `i P h o n e` which is at all like an iphone.
We have just stipulated this connection. The machine replays these stipulations to us -- it does not make them, as we do.
LLMs cheat at generating text because they do so via a model of the statistical structure of text.
We're in the world, it is us who stipulate the meaning of words and the structure of text. And we stipulate new meanings to novel parts of the world daily.
What else is an 'iPhone' etc. ? There's nothing in `i P h o n e` which is at all like an iphone.
We have just stipulated this connection. The machine replays these stipulations to us -- it does not make them, as we do.