Comment by ycui7

llm is not a deterministic program. the same model won't even return deterministic answer. what's the point keep the model freezed?

if you want deterministic returns, you should set the temperature to 0 to get the best possibility of deterministic.