Comment by andyljones

Gary Marcus - the author of this - has previously offered several concrete tests that he felt demonstrated the limitations of the GPT approach.

GPT-3 smashed them.

https://www.gwern.net/GPT-3#marcus-2020