I think you're right in that it has the shape but I think it's missing a pretty key piece. We still haven't been able to solve catastrophic forgetting, yet everything with a brain has. Basically LLMs seem good at approximating intelligence on a moment-to-moment basis, but feel quite far away when you chat with one over time.
Like at some level, yes, transformers are trying to emulate a human brain but the second you ask folks if they do a good job of it, I think most rationale people would say no.
Like at some level, yes, transformers are trying to emulate a human brain but the second you ask folks if they do a good job of it, I think most rationale people would say no.