throwifasd
Joined 3 years ago
Karma
-16
Submissions
19
Member since
Jan 4
Recent submissions
Comment · 3 years ago
Please to have a sane discussion refrain from attributing your fears as facts. Nothing what you mention is done by this update.
Comment · 3 years ago
But it's fun telling pretentious HNers that they they are wrong.
Comment · 3 years ago
Just because HN is where some journalists found a link doesn't make it a news source it just shows that everyone reading HN could replace them.
Comment · 3 years ago
The fact is just no matter how easy it is to create most people decide to rather just consume.
Comment · 3 years ago
You really are like a chatbot... look at the last three node sizes and the density of ram in them. It's not gonna happen as fast as you dream about it especially not with the discounts of the last Gens. The hope is to go to fp4 if you want to run it on consumer hardware and we are still not talking to about 2-3 cards. Why not at least try to Google before hammering down on stupid and uninformed hot takes?
Comment · 3 years ago
This post [0] is a good primer and they are talking about a 20b model gpt3 has 175b. Their other posts go more into details but yes, it really is a massive operation.
Some hard facts from here [1] talking about BLOOM with 175b parameters..
>> Installing the full 175B version is a challenge though as it requires around 350GB of GPU VRAM, which is not something one can easily afford.
But hey why deploy a model like chatGPT at all when you guys can be confidently incorrect all by yourselves.
[0] https://nlpcloud.com/deploying-gpt-neox-20-production-focus-...
[1] https://nlpcloud.com/chatgpt-open-source-alternatives.html
Comment · 3 years ago
yeah, that's not what op asked about. That's one of those smaller models that "suck" as you said so confidently in your first comment. Not even close to gpt3/chatgpt. Next time when I talk bullshit I just post a random py file to make my argument. lmao