goose-
Joined 2 years ago
Karma
47
Submissions
6
Member since
Dec 21
Joined 2 years ago
In an ideal setting, a trained model learns exactly the real world probability distribution, and generates data indistinguishable from those sampled from the real world. Training on them would be fine, but pointless, since the model is already a perfect representation of the real world.
Practically, however, a model is only a lossy approximation of the real world probability distribution. Repeated self-training would simply compound the loss - amplifying both the probable and the improbable.
Bonus tip: while focused on the overlapping image in the middle, jiggle your screen, and the diff will move around while the rest remains static. This helped me solve the impossible challenge instantly.
I'd love to learn more about the underlying mechanism here. Anyone can point me in the right direction?