Comment Comment by 2023throwawayy This is the only part of AI that actually terrifies me.I’ve run into people on this very site who use LLMs as a doctor, asking it medical questions and following its advice.The same LLMs that hallucinate court cases when asked about law.The same LLMs that can’t perform basic arithmetic in a reliable fashion.The same LLMs that can’t process internally consistent logic.People are following the medical “advice” that comes out of these things. It will lead to deaths, no questions asked. parent 2023throwawayy 2 years ago
I’ve run into people on this very site who use LLMs as a doctor, asking it medical questions and following its advice.
The same LLMs that hallucinate court cases when asked about law.
The same LLMs that can’t perform basic arithmetic in a reliable fashion.
The same LLMs that can’t process internally consistent logic.
People are following the medical “advice” that comes out of these things. It will lead to deaths, no questions asked.