Comment

Comment by ethan1998

If you change reasoning during a session, LLM needs to recompute KV cache. Maybe I get it wrong, but I don't think it can save money.
parent ethan1998 1 month ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton