Comment

Comment by Edman274

I think a way to think about it is that we (at a societal level) wouldn't accept a desk calculator to be sold as a consumer product if it did correct arithmetic almost all of the time but then would spit out a close but wrong answer 1 time out of 1000, even if that would be significantly better than the average person doing arithmetic. Our expectation would be that it could (and should) perform flawlessly. If our technological progress was such that the only calculator we could ever hope to produce would still have that kind of error 1 time in 1000, would it be unethical to prevent that from being sold? That's hard to say!

One of the heuristics built into us (because we're mortal beings living beings in a competitive, historically resource-poor environment) is that we trust the devil we know more than the devil we don't, and so unless there's a strongly compelling reason to trust autonomous driving devices a lot more than humans, there will be some inertia against using them, even if the calculations are that it will save X number of lives. I mean, inherent in that calculation is a level of uncertainty and people don't necessarily trust that number, because they don't have a reason to trust it, because they haven't really seen enough to trust it. Why take a company's word for it that it's safer when they have a financial incentive to do some creative stuff to get their marketing pitch? I would say that if you feel it doesn't reflect well on us, it's because it hasn't been thought about enough.

parent Edman274 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton