Comment by theluketaylor

True, but even a hallucinated explanation of where things went wrong added to the context can force the model down a better path over the next few inputs.