mlubin01
Joined 4 years ago
Karma
2
Submissions
7
Member since
Aug 26
[email protected]
View on Hacker NewsJoined 4 years ago
You can avoid this with double buffering. At ~70% capacity, summarize into a checkpoint and start a back buffer. Keep working. Append new messages to both. When the active context hits the wall, swap. The new context has compressed old history + full-fidelity recent messages.
Same single summarization call you'd make anyway, just earlier — when the model isn't at the attention cliff. 40-year-old technique (graphics, databases, stream processing). Nobody had applied it to LLM context. Worst case degrades to exactly today's status quo.
A few threads in there:
- The design spectrum from minimal structure (Mem0: two LLM calls, no schema) to rich structure (Graphiti: bi-temporal edges, two-phase entity dedup, per-edge contradiction detection)
- Hindsight running 4-way parallel retrieval with cross-encoder reranking on a single PostgreSQL database
- Hyperspell prioritizing data access over knowledge construction — 43 OAuth integrations, zero extraction. Not a different approach to the same problem, a bet that the bottleneck is upstream.
- Structure without selection pressure is art. Many of these systems build elaborate relationship schemas with no mechanism to decide what's worth remembering.
- Tacnode thinking from the infrastructure layer up — ACID, time travel, multi-modal storage. Nobody else is really working from that depth. Both layers matter.
- The article also asks what memory actually is for agents that need to plan and adapt, not just recall. Most systems converge on extract-store-retrieve. Some are hinting at something deeper.
All systems at pinned versions. Point-in-time, not a ranking.