This style of argument has always bothered me, because the correction to misdiagnosis or mistreatment is not to stop looking, it's _git gud_.
For sure, we have to be realistic about what processes will systematically have error, and if we can't stop a doctor from doing bad things with a piece of data we should shield them from it, but the tools to make scalable, calibrated risk estimates based on large data dumps is getting better every year.
For sure, we have to be realistic about what processes will systematically have error, and if we can't stop a doctor from doing bad things with a piece of data we should shield them from it, but the tools to make scalable, calibrated risk estimates based on large data dumps is getting better every year.