Comment by Veedrac

> I still think there's tasks that GPT-3 has no chance of tackling (say, generating code to solve a novel programming task)

Umm https://www.youtube.com/watch?v=y5-wzgIySb4

That was a smaller model fine-tuned on Github IIRC.