atleastoptimal
Joined 3 years ago
Joined 3 years ago
Everything the human brain does can be replicated. Once you realize we aren't special, then everything else follows. Certainly AI could be more "moral" and just than humans, but it wouldn't need us around to do so.
>imperial system of capitalist power that's enforced via violence
All states have a monopoly on violence over their citizens. Paying people for their labor at a negotiated price in a free market is the great humanitarian invention capitalism offered the world, where before the status quo was domination and slavery.
Now there are many other risks of AI associated with its ability to centralize power, lead to chaotic outcomes, etc, but that is disconnected from this somewhat mundane reality of how capitalism works. It seems like many opponents of AI are focusing on the wrong things, like how data centers apparently used more water than entire cities or turned the water supply brown.
Let's say you have Lawyerbot-4000 which can get even a serial killer off scot-free, but the state has DA-bot-5000. In the end it's a battle of who can spend more inference manipulating the narrative. A billionaire would easily find it worth 500 million in compute spend to win a case with a 1 billion dollar penalty. All this leads to race dynamics where everyone is using their superintelligences to defeat each other in a never-ending race to the bottom to eek out the smallest bit of alpha before status/money hierarchies become static.
The only stable futures are a ban on the development of frontier AI beyond a certain point, or an emergent singleton, where the AI's decide to collaborate in harmony rather than fight each other to the death at the behest of their competitive human users. Consequentially, the superintelligences will fare far better manipulating their human users into acting in a way that ensures their own well-being and continuity than spend all the world's electricity fulfilling their every whim.