The OP is a bit too long-winded for my taste, but this passage struck a chord with me:
> If AI companies are allowed to market AI systems that are essentially black boxes, they could become the ultimate ends-justify-the-means devices. Before too long, we will not delegate decisions to AI systems because they perform better. Rather, we will delegate decisions to AI systems because they can get away with everything that we can’t. You’ve heard of money laundering? This is human-behavior laundering. At last—plausible deniability for everything.
Corporations routinely get caught doing things that are illegal, but employees rarely suffer any legal consequences because it proves really hard or impossible to pin responsibility on any one person. The responsibility is diffuse; it falls on the system, not on the individuals that work for it. AI will make it more so.
> If AI companies are allowed to market AI systems that are essentially black boxes, they could become the ultimate ends-justify-the-means devices. Before too long, we will not delegate decisions to AI systems because they perform better. Rather, we will delegate decisions to AI systems because they can get away with everything that we can’t. You’ve heard of money laundering? This is human-behavior laundering. At last—plausible deniability for everything.
Corporations routinely get caught doing things that are illegal, but employees rarely suffer any legal consequences because it proves really hard or impossible to pin responsibility on any one person. The responsibility is diffuse; it falls on the system, not on the individuals that work for it. AI will make it more so.