Self-driving cars may be safer than manually driven cars in certain contexts.
What's missing from AI is reliability. It's brittle, it works well in some situations and not at all in others.
Which is a problem, because you can never be sure how well it's working for you.
There's no anti-Dunning-Kruger-function to say "I'm sorry Dave, I can't handle this, you should take over" - partly because that's not something you want to experience driving into a hail storm at 70mph on a freeway if you're asleep, but also because it would require a level of domain-specific AI self-awareness that is barely on the radar in most domains.
What's missing from AI is reliability. It's brittle, it works well in some situations and not at all in others.
Which is a problem, because you can never be sure how well it's working for you.
There's no anti-Dunning-Kruger-function to say "I'm sorry Dave, I can't handle this, you should take over" - partly because that's not something you want to experience driving into a hail storm at 70mph on a freeway if you're asleep, but also because it would require a level of domain-specific AI self-awareness that is barely on the radar in most domains.