Cory Doctorow has talked about how "they" test these kinds of things on captive "audiences" - mainly children and prisoners - before expanding to the rest of us. I tend to add marginalized groups to that list. Even when a person can nominally be held accountable, it doesn't matter if you can't reach them, protected by an administrative or institutional barrier of some kind.
Standardized testing and remote learning monitoring, automated sentencing software, and any number of social programs are examples, if you were wondering.
So, part of the problem is the signalling that the tolerating of these practices when they happen to those less able to defend themselves presents to companies. "Go ahead, do it, you'll get away with it." I tend to think: because the people with the power to stop it benefit from it.
Standardized testing and remote learning monitoring, automated sentencing software, and any number of social programs are examples, if you were wondering.
So, part of the problem is the signalling that the tolerating of these practices when they happen to those less able to defend themselves presents to companies. "Go ahead, do it, you'll get away with it." I tend to think: because the people with the power to stop it benefit from it.