Comment by NwpierratorR

Memory is solvable tho.

Either through hacky means via RAG + prompt injections + log/db of interaction history or through context extensions.

IF you have a billion tokens of effective context, you might spent years until it is filled in full.