I suspected the root cause of this situation was due to the income signal, not credit score. I bet that Goldman Sachs is not correctly accounting for California community property laws, where 50% of the household income is hers. This seems like the exact type of oversight that is:
- Not “technically” using gender as a signal
- Ends up practically causing gender-based unfairness
- Is simply bad data and I would consider a bug
- Is something customer service is not going to be helpful with
I’m glad this issue came to light. I hope it leads to productive conversations about black-box algorithms and underwriting.
- Not “technically” using gender as a signal
- Ends up practically causing gender-based unfairness
- Is simply bad data and I would consider a bug
- Is something customer service is not going to be helpful with
I’m glad this issue came to light. I hope it leads to productive conversations about black-box algorithms and underwriting.