> IMHO in order for AI to be truly useful, we need to be able to trust it.
A common response to this by AI advocates is to point out that humans lie all the time, as long as the AI lies less than humans (debatable at this current point anyway) its an improvement.
I think what that forgets is the importance of context. We all know humans are perfectly capable of lying, but we don't generally expect that of software. If your compiler lied about your code being valid, I doubt the general response would be "meh, its only done that once, I've lied far more than that"
A common response to this by AI advocates is to point out that humans lie all the time, as long as the AI lies less than humans (debatable at this current point anyway) its an improvement.
I think what that forgets is the importance of context. We all know humans are perfectly capable of lying, but we don't generally expect that of software. If your compiler lied about your code being valid, I doubt the general response would be "meh, its only done that once, I've lied far more than that"