Comment by vatsachak

Thanks for pointing this out.

The reason why LLMs cannot be purely* pre-trained on LLM outputs is because LLM output diversity is low.

This implies two things:

1) There is going be no functional difference between hypothetical Qwen 4.5 and Fable 5.5

2) LLMs are not AGI