Comment

Comment by froobius

> context a session moves grows with roughly the square of its length

Readme doesn't mention that LLM providers do context caching — your costs aren't quadratic unless you frequently invalidate the cache.

parent froobius 1 month ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton