Comment by jerb

I want to be wildly optimistic too, but I still see no evidence LLMs generate new knowledge. They always hew in-distribution.

Please correct me if I’m wrong