Comment by h1t35h

What do you mean when you say consistent response is a problem ? Is it that each time the response varies or that the response cannot be relied upon.

Have you tried fiddling around with temperature or SQL specific finetuned models?