Instead of going into a long technical argument of why your description of LLMs is flawed, I'll go straight to the point, because people keep moving the goal posts.
What exact problem would need to be solved by LLMs to convince you that they DO discover novel solutions?
What exact problem would need to be solved by LLMs to convince you that they DO discover novel solutions?