(I really like the framing of "weakly general AI" since it puts the emphasis on the generality and not whether it's a superintelligence)
Edit: Probably not today, but mostly because 1.2B parameters isn't enough to get it the high winograd scores that PaLM etc have. But it seems pretty clear you could scale this architecture up and it will likely pass. The question is when someone will actually train a model that can do it
Date Weakly General AI is Publicly Known: https://www.metaculus.com/questions/3479/date-weakly-general...
(I really like the framing of "weakly general AI" since it puts the emphasis on the generality and not whether it's a superintelligence)
Edit: Probably not today, but mostly because 1.2B parameters isn't enough to get it the high winograd scores that PaLM etc have. But it seems pretty clear you could scale this architecture up and it will likely pass. The question is when someone will actually train a model that can do it