Comment by bardan

For me the baseline is if an AI made up a new joke that is actually funny. As you say it's sort of an "I know it if I see it" issue, but anyone who has tried to prompt a language model to come up with a novel, funny joke knows that these models aren't really demonstrating human-like intelligence.