Comment by dghlsakjg

Are llms truly non-deterministic?

My impression was that we inject some randomness intentionally to mimic it, but if you remove that factor you end up with a deterministic chat model.