Comment by kentonv

LLMs will tell you whatever you want to hear. You subtly direct them with the way you ask the question, and then they give you the answer you want. That's basically what they're trained to do. So of course they always give you the answer you want -- but you can't just go around telling people to ask an LLM to back up your argument, as other people will get a difference answer.