danrocks
Joined 5 years ago
Karma
2,014
Submissions
312
Member since
Aug 12
Joined 5 years ago
I don't think this is accurate. The Stanford team used LLaMA as base model and added a smaller model on top of it - training the joint model using data (generated from ChatGPT) is what cost $600. Nobody trained a GPT-like model from scratch for $600 - this experiment took advantage of the millions of USD used to train the larger models.
Y no, no soy colombiano pero mi familia si lo es. Soy de otro narco-state.
Also there's money in selling Fentanyl.