Comment by zawaideh

Something like this might work well for managing long context for LLMs!