This post [0] is a good primer and they are talking about a 20b model gpt3 has 175b. Their other posts go more into details but yes, it really is a massive operation.
Some hard facts from here [1] talking about BLOOM with 175b parameters..
>> Installing the full 175B version is a challenge though as it requires around 350GB of GPU VRAM, which is not something one can easily afford.
But hey why deploy a model like chatGPT at all when you guys can be confidently incorrect all by yourselves.
Some hard facts from here [1] talking about BLOOM with 175b parameters..
>> Installing the full 175B version is a challenge though as it requires around 350GB of GPU VRAM, which is not something one can easily afford.
But hey why deploy a model like chatGPT at all when you guys can be confidently incorrect all by yourselves.
[0] https://nlpcloud.com/deploying-gpt-neox-20-production-focus-...
[1] https://nlpcloud.com/chatgpt-open-source-alternatives.html