I'm confused on how you're defining stored vs rediscovered. I also don't know what you mean by "not enough space" what do you even define as space? Feel like we're talking past each other here.
The Q&A are purposely not guessable. The only way it could answer that correctly is it must have it baked into the weights somewhere. What I'm saying is that the configuration of the weights hid that information then random chance reemerged that information again after it had
forgotten and self reinforced it without any training signal to do so.
The Q&A are purposely not guessable. The only way it could answer that correctly is it must have it baked into the weights somewhere. What I'm saying is that the configuration of the weights hid that information then random chance reemerged that information again after it had forgotten and self reinforced it without any training signal to do so.