Comment

Comment by rushingcreek

I see you're using [INST] tokens. Please don't do this -- this model was not trained in this format or to be a chat model.

Instead, it should be treated as a completions model (like text-davinci-003) and no system prompt should be provided.

Just tell it what you want.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton