I guess it depends how you think about it. From computational perspective, it's heavyweight. On the other hand, it really optimizes for minimal human effort, on several levels:
* GPT-3 is conceptually simple: the effort to invent it and engineer it amortizes well.
* Once the model is trained, it can be reused to very different tasks.
* GPT-3 is conceptually simple: the effort to invent it and engineer it amortizes well.
* Once the model is trained, it can be reused to very different tasks.
* Querying doesn't require programming knowledge.