Comment by eximius

That raises an interesting point. On the one hand, novelty is in the eye of the beholder, if you will. What has been done before might still be new to many. On the other, randomness is built in and language has a remarkable capacity for uniqueness (see statistics about novel queries on Google). So it's possible and likely for LLMs to generate novel sentences. Whether those are valuable is a harder thing to think about.