Lots of people here hate Marcus, and he can lay it on thick, but I quite like him. He has actually studied human cognition and intelligence outside of programming – something that can't be said about a great many AI pundits.
I'm doing an interdisciplinary PhD in CS and Music right, so both music cognition and AI is in my program. From what I can see (which is not a lot of data, I admit) no one who has actually studied music cognition would think LLMs are going to lead to AGI by scaling. Linguistic thinking is only a small part of human intelligence, and certainly not the most complex. LLMs are so, so far from being able to the thinking that goes in a real-time musical improvisation context it's laughable.
I'm doing an interdisciplinary PhD in CS and Music right, so both music cognition and AI is in my program. From what I can see (which is not a lot of data, I admit) no one who has actually studied music cognition would think LLMs are going to lead to AGI by scaling. Linguistic thinking is only a small part of human intelligence, and certainly not the most complex. LLMs are so, so far from being able to the thinking that goes in a real-time musical improvisation context it's laughable.