I'm not sure how you'd land on an LLM being unable to invent anything new. You'd have to both understand exactly what LLMs are and aren't capable of today and what allows human creativity. I don't think there are good answers to either.
It seems unlikely that recursively predicting the next word would lead to creativity or invention, but it doesn't seem impossible. Similarly, it seems unlikely that human thought works in a similar prediction loop, but it doesn't seem impossible.
It seems unlikely that recursively predicting the next word would lead to creativity or invention, but it doesn't seem impossible. Similarly, it seems unlikely that human thought works in a similar prediction loop, but it doesn't seem impossible.