Comment by podocarp

Meh it doesn't know what's "easy to understand" because it's trained on the average of the whole internet and it's mostly junk out there. Sadly the amount of junk obviously vastly outweighs the actual good writers so as long as you're just feeding it like this nothing will change. RLHF also just biases towards the average/mediocre because it's again the average of all user choices. If you want a PhD level chatbot you might need to enslave a couple hundred PhDs and milk them for a few years first. But under duress they will not perform optimally either.