Comment

Comment by pomtato

not from a tech field at all but would it do the context window any good to use "think" mode but discard them once the llm gives the final answer/reply?

is that even possible to disregard genrated token's selectively?

parent pomtato 1 year ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton