One doesn't invalidate the other. Yes LLMs have been very successful at solving math problems when guided by mathematicians who know what they're doing. The same is true for emulating a PS5 or (insert cool new project of the week developed with LLM).
On the other hand, when I use LLMs, I regularly see them confidently claim information confidently that is false. So, I'd say productivity gains are true but there's also a cost of wrong information being used to make decisions due to AI.
On the other hand, when I use LLMs, I regularly see them confidently claim information confidently that is false. So, I'd say productivity gains are true but there's also a cost of wrong information being used to make decisions due to AI.