I'm somewhat surprised no one here views this as an automated decisionmaking problem
It's increasingly clear that automating important decisions like this is causing a lot of harm while removing most forms of recourse available to those affected. Coupled with the way automated decisions are used to perform and then launder fraud on a massive scale, maybe we should target laws at the automation itself: Require decisions made by automated systems of any kind to be auditable and explicitly define what human is held responsible and what remedies can be applied
It's increasingly clear that automating important decisions like this is causing a lot of harm while removing most forms of recourse available to those affected. Coupled with the way automated decisions are used to perform and then launder fraud on a massive scale, maybe we should target laws at the automation itself: Require decisions made by automated systems of any kind to be auditable and explicitly define what human is held responsible and what remedies can be applied