This is super interesting, and I think depends how you define information.
You can take some information, combine it with other information, apply various kinds of reasoning to it, and get something new as a result.
E.g. (1) Bob is a monkey. (2) All monkeys like banannas. Would you call it "new information" if I tell you that Bob likes banannas? LLMs can do this to varying degrees of success, so probably not.
Maybe you mean something like in Information Theory, where information is something that resolves uncertainty?
It'd be interesting to know, what is it you think humans are capable of that LLMs can't be?
You can take some information, combine it with other information, apply various kinds of reasoning to it, and get something new as a result.
E.g. (1) Bob is a monkey. (2) All monkeys like banannas. Would you call it "new information" if I tell you that Bob likes banannas? LLMs can do this to varying degrees of success, so probably not.
Maybe you mean something like in Information Theory, where information is something that resolves uncertainty?
It'd be interesting to know, what is it you think humans are capable of that LLMs can't be?