mirekrusin
Joined 12 years ago
Karma
5,731
Submissions
3,045
Member since
Sep 4
https://mirekrusin.com
View on Hacker NewsJoined 12 years ago
Post training directly evolves existing model weights using the same optimization process that created them.
Software: source code -> compiler -> binary
Models: weights + training data + optimizer -> updated weights
Ie. binary is output of the development process.
Model weights are both – it's output and it's direct input for further development.
Model weight snapshots are continuously used all the time in this iterative process from the very beginning, being output of current step and input to the next step.
For example there are more than 100k modified weights on hugging face.
Once government clear it, it'll become available.
Same delay process will happen to new frontier models from other US labs.