>Ilya claims the transformer architecture, with some modification for efficiency, is actually sufficient for AGI.
I thought this guy was supposed to know what he's talking about? There was a paper that shows LLMs cannot generalise[0]. Anybody who's used ChatGPT can see there's imperfections.
I thought this guy was supposed to know what he's talking about? There was a paper that shows LLMs cannot generalise[0]. Anybody who's used ChatGPT can see there's imperfections.
[0] https://arxiv.org/abs/2309.12288