Comment

Comment by gringofyx

No, not necessarily - the prompt-cache is only hit if everything prior matches... including MCP & tool definitions. So to benefit from prompt-caching themselves they would need to include the tools you define to the summariser.

If they were doing that, then a cheaper (prompt-cache friendly) option is just to silently send the whole conversation with the summariser prompt appended

parent gringofyx 3 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton