Comment

Comment by breisa

They are talking about the chat template and not the system prompt. With current gen models, the system prompt is only part of a larger pretext that is passed to the model at the start of the "chat". The models are trained on a specific chat template with things like tool lists, reasoning budget, special feature flags and the "system prompt" formatted in a certain template.
parent breisa 7 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton