Comment by Zierax

I 'v been work on similar project last months, I guess the new attention direction will be on Co-memory contexts instead of making the models have more context memory but hallucinating more