I asked Chat GPT which antacid medications are contraindicated for some medication I'm on. Easily found through NICE.
It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit.
I think as much as hyping the benefits we need to hype the flaws and dangers.
If the public at large learn to trust these LLMs too quickly and deeply, that's a hard hole to dig out of. Skepticism in all information sources is a key critical thinking life skill.
That skill is harder to apply the more natural the information source seems and the more ambient the information.
It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit.
I think as much as hyping the benefits we need to hype the flaws and dangers.
If the public at large learn to trust these LLMs too quickly and deeply, that's a hard hole to dig out of. Skepticism in all information sources is a key critical thinking life skill.
That skill is harder to apply the more natural the information source seems and the more ambient the information.