Comment by thenberlin

Yeah, no kidding. This is what LLMs are not meant for 101 -- it'll get a lot right, a solid amount of the time (spare me the anecdotes), but the idea that someone who doesn't know anything about a topic should take its output for ground truth is exactly the sort of misplaced trust that risks flipping these models from massive technological/productivity/scientific/etcetc leap into existential threat.