Multiple times yesterday I caught Claude giving slightly incorrect information about things it had read in docs and source code. Its info was accurate enough to be plausible, but it was still wrong. And when I pointed that out, it agreed that it had overstated or made statements without verifying them.
It would be terrible to be doing an emergency medical procedure and have an AI backtrack on something it had told you to do.
It would be terrible to be doing an emergency medical procedure and have an AI backtrack on something it had told you to do.