Comment by threepts

All of the major model's memory are handled by smaller more specific models.

I do not know about the future, but I believe, like the human brain (the amylgada + cerebral cortex), AGI will have smaller but more specific submodels running in parallel to craft an compelling heuristic.