There still isn't any evidence that it can pass novel Winograd schemas (as in, ones it cannot possibly be trained on), which almost every human can pass. The abstract reasoning corpus is more of a "lots of people will fail this too" test, but if a human is approaching it carefully they will be able to do it and there's still no evidence that GPT-4 can do it reliably (I expect that to change once it's multimodal).
The systems are very impressive and I think there is a 'there' there, they're clearly intelligent to some significant degree. But it's incorrect to say that they pass every test.
The systems are very impressive and I think there is a 'there' there, they're clearly intelligent to some significant degree. But it's incorrect to say that they pass every test.