Comment Comment by qeternity > LLMs are non-deterministicThis is not true. Non determinism only arises via sampling, and to a much lesser extent, CUDA kernel launch subtleties. parent qeternity 13 days ago
This is not true. Non determinism only arises via sampling, and to a much lesser extent, CUDA kernel launch subtleties.