Almost all the comments I've seen criticizing ChatGPT run into the same fallacy: they're applying a double standard compared to humans. What you said applies to output produced by humans as well. Similarly, many humans also have difficulty doing multiplication with large integers, differentiating between truth and fiction, answering with non bullshit answers, etc. Sure, it's probably a question of degree (and it's an important limitation), so we could probably say it's at the level of a dumb human, but even so, it can already exceed the average human's capabilities in many interesting and useful tasks!
And not only that, what's most amazing is that it can exceed humans at abilities that many years ago, most people thought only humans could accomplish (tasks including creativity, including creating art, writing poems/literature, interpreting ambiguous human questions and text, doing analogy-based reasoning and problem solving, grasping and explaining puns, making new jokes, etc). And these models can only improve in the future!
And not only that, what's most amazing is that it can exceed humans at abilities that many years ago, most people thought only humans could accomplish (tasks including creativity, including creating art, writing poems/literature, interpreting ambiguous human questions and text, doing analogy-based reasoning and problem solving, grasping and explaining puns, making new jokes, etc). And these models can only improve in the future!