Comment

Comment by josvdwest

I think the main issue with removing certain previous responses from context would be that you no longer hit the cache for a large part of your chat history, which makes responses much more expensive and slow.

Its faster and cheaper (in most cases) to leave the history as is and hit the cache.

parent josvdwest 1 year ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton