Comment

Comment by ACCount36

1. You train a model to exhibit a certain behavior

2. You use it to make synthetic data, data that's completely unrelated to that behavior, and then fine tune a second model on that data

3. The second model begins to exhibit the same behavior as the first one

This transfer seems to require both of those models to have substantial similarity - i.e. to be based on the same exact base model.

parent ACCount36 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton