You ignored my comment about NFR. But, if you really wanna harp on the non-determinism. I don't think humans and LLMs are actually non-deterministic in the same way?
Humans are non-deterministic when compared between humans. But if you give a human the same task they can be pretty consistent. Models quality varies much more than a single human does and human's reasoning don't reset with their context window. Otherwise tenure wouldn't matter, companies wouldn't try to retain specific talent, and pay bands wouldn't be so wide. But thanks for spelling it out.
Humans are non-deterministic when compared between humans. But if you give a human the same task they can be pretty consistent. Models quality varies much more than a single human does and human's reasoning don't reset with their context window. Otherwise tenure wouldn't matter, companies wouldn't try to retain specific talent, and pay bands wouldn't be so wide. But thanks for spelling it out.