Comment

Comment by mirekrusin

You're conflating runtime patching with continuing development.

Post training directly evolves existing model weights using the same optimization process that created them.

Software: source code -> compiler -> binary

Models: weights + training data + optimizer -> updated weights

Ie. binary is output of the development process.

Model weights are both – it's output and it's direct input for further development.

Model weight snapshots are continuously used all the time in this iterative process from the very beginning, being output of current step and input to the next step.

parent mirekrusin 2 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton