Comment by matteoraso

>It cant "invent new things". It can only reuse what it already knows about.

This is outdated. With RLVF, LLMs can create their own training data instead of relying on what it's been fed.