I'm of the opinion that the current architectures are fundamentally ridden with "hallucinations" that will severely limit their practical usage (including very much what the hype thinks they could do). But this article puts an impossible limit to what it is to "not-hallucinate".
It essentially restates well known fundamental limitations of formal systems and mechanistic computation and then presents the trivial result that LLMs also share these limitations.
Unless some dualism or speculative supercomputational quantum stuff is invoked, this holds very much to humans too.
It essentially restates well known fundamental limitations of formal systems and mechanistic computation and then presents the trivial result that LLMs also share these limitations.
Unless some dualism or speculative supercomputational quantum stuff is invoked, this holds very much to humans too.