Comment Comment by ACCount36 1. You train a model to exhibit a certain behavior2. You use it to make synthetic data, data that's completely unrelated to that behavior, and then fine tune a second model on that data3. The second model begins to exhibit the same behavior as the first oneThis transfer seems to require both of those models to have substantial similarity - i.e. to be based on the same exact base model. parent ACCount36 1 year ago
2. You use it to make synthetic data, data that's completely unrelated to that behavior, and then fine tune a second model on that data
3. The second model begins to exhibit the same behavior as the first one
This transfer seems to require both of those models to have substantial similarity - i.e. to be based on the same exact base model.