Comment by WhitneyLand

> the output token of the LLM (black box) is not deterministic. Rather, it is a probability distribution over all the available tokens

How is this not deterministic? Randomness is intentionally added via temperature.