How would you make the system moral?
Let's say "moral" means "won't discriminate based on X" and the same "system" is used by everyone, which of course it wouldn't be.
So do you make up a bunch of fake "people" who are equal in everything except X, and test that it doesn't advantage/disadvantage the X's? Would that even be possible if the "system" is getting its inputs from social media?
Do you do mandate some kind of audit of the system's decisions, and require it to choose on average the same percentage of Xs as... what? As there are Xs in the general population? In the candidate pool?
I'd love for this kind of thing to work but even in an idealized hypothetical version it's hard to see how it could.
I think in tech we've already shown that shame is no barrier to hiring discrimination, and as HR+AI type filtering systems preselect candidates for you it'll be harder and harder for you or the government or the disadvantaged candidates to even know if you're discriminating.
You'll judge the "system" based solely on whether the set of candidates you got achieved the outcome you needed.
Let's say "moral" means "won't discriminate based on X" and the same "system" is used by everyone, which of course it wouldn't be.
So do you make up a bunch of fake "people" who are equal in everything except X, and test that it doesn't advantage/disadvantage the X's? Would that even be possible if the "system" is getting its inputs from social media?
Do you do mandate some kind of audit of the system's decisions, and require it to choose on average the same percentage of Xs as... what? As there are Xs in the general population? In the candidate pool?
I'd love for this kind of thing to work but even in an idealized hypothetical version it's hard to see how it could.
I think in tech we've already shown that shame is no barrier to hiring discrimination, and as HR+AI type filtering systems preselect candidates for you it'll be harder and harder for you or the government or the disadvantaged candidates to even know if you're discriminating.
You'll judge the "system" based solely on whether the set of candidates you got achieved the outcome you needed.