I just think there are fundamentally other pieces required that we will not see with a pure LLM, or with what we today call an LLM. I totally think we can get there but we need to do more than just create language. We need to have intentions, memories of experiences, meta learning, goals, etc that just do not exist in LLMs as we know them. You can only fake it so much before the trick wears thin. They have their utilities today, but they are not like talking to a real human even if it can be hard to tell the difference in short conversations.
For example LLMs today will lie without realizing it, or contradict themselves in ways that humans don't. And I think the above pieces missing are the reason for this. Going multimodal helps in some areas, but it is not enough.
For example LLMs today will lie without realizing it, or contradict themselves in ways that humans don't. And I think the above pieces missing are the reason for this. Going multimodal helps in some areas, but it is not enough.