This is extremely fascinating. The sort of thoughts and sensations without consciousness she describes experiencing before language gave her consciousness - maybe this is the spark that LLMs do not have and humans do. It would be astounding if it turned out LLMs do have consciousness (as in, awareness of themselves) as it's a byproduct of language, but they don't have those embodied thoughts and feelings that Helen describes having before she had language. An entity like that has never existed before. We have conscious humans with language, and humans like Helen Keller pre-language who felt impulses, sensations, aping but not consciousness, but I don't think there has ever been a human with consciousness but without any impulse.
I wonder what we could do to marry that language ability to think about the self and others and abstract concepts and the big social web, with the sort of embodied spark & impulses that Helen describes. Would it be as simple as building a model physically embodied in a robot? Training a model on robotic sensory data from a body that it inhabits, then overwriting that training with language? I think a lot of this is navel-gazing in that it's obviously unrelated to any productive capabilities, but I do think it's worth thinking about. What if we can?
I wonder what we could do to marry that language ability to think about the self and others and abstract concepts and the big social web, with the sort of embodied spark & impulses that Helen describes. Would it be as simple as building a model physically embodied in a robot? Training a model on robotic sensory data from a body that it inhabits, then overwriting that training with language? I think a lot of this is navel-gazing in that it's obviously unrelated to any productive capabilities, but I do think it's worth thinking about. What if we can?