Comment Comment by jcoder > All requests to an LLM are idempotent, for every API call you need to send it the entire conversation historyA more appropriate term is “stateless”. LLM responses are certainly not idempotent, as they are not even deterministic. parent jcoder 3 months ago
A more appropriate term is “stateless”. LLM responses are certainly not idempotent, as they are not even deterministic.