I think it's a mistake to judge the performance of GPT-3 like this because it's not comparing apples to apples. What GPT-3 is doing is equivalent to me giving you a book in Chinese (without any further context, translation or grounding in the physical world) and then expecting you to produce articles in Chinese. This is plainly impossible for any human and it's amazing that it can do this at all.
A human generates language while having knowledge of entire other modalities that GPT-3 lacks - vision, audio, proprioception and more. No, of course GPT-3 doesn't know what it's talking about, it's only ever seen tokens! What you should be asking is, what will happen when these modalities are incorporated, when it does know what it's talking about. Personally I suspect a massive number of white collar workers that mostly work with text are about to become obsolete.
A human generates language while having knowledge of entire other modalities that GPT-3 lacks - vision, audio, proprioception and more. No, of course GPT-3 doesn't know what it's talking about, it's only ever seen tokens! What you should be asking is, what will happen when these modalities are incorporated, when it does know what it's talking about. Personally I suspect a massive number of white collar workers that mostly work with text are about to become obsolete.