Comment Comment by Terr_ > to see LLM re-discoverI imagine someone probably wrote very specifically about it in the training data that underwent lossy compression, and the LLM is decompressing that how-to.So I'd say it's more like "surfacing" or "retrieving" than "re-discovering". parent Terr_ 6 months ago
I imagine someone probably wrote very specifically about it in the training data that underwent lossy compression, and the LLM is decompressing that how-to.
So I'd say it's more like "surfacing" or "retrieving" than "re-discovering".