"We are releasing all of our models between
125M and 30B parameters, and will provide full
research access to OPT-175B upon request.
Access will be granted to academic researchers; those
affiliated with organizations in government, civil
society, and academia; and those in industry research laboratories."
GPT-3 Davinci ("the" GPT-3) is 175B.
The repository will be open "First thing in AM" (https://twitter.com/stephenroller/status/1521302841276645376):
https://github.com/facebookresearch/metaseq/