I disagree. Yes, it is just a decoder of transformer. But it looks like we are really close, with some tweaks on the network structure, reward function design and inputs / outputs. On the same time, GPT-3 also points how far away we are at hardware level.
Let me put it this way: I don't know how challenging the rest is going to be, but it surely looks like we are on the right path finally.
Let me put it this way: I don't know how challenging the rest is going to be, but it surely looks like we are on the right path finally.