So what happens when they achieve AGI? Will a benevolent network of vastly smarter-than-human intelligences insist on maintaining the wealth hierarchies that humans had before AGI arrived? Isn't the point of AGI removing scarcity?
I worry that those who became billionaires in the AI boom won't want the relative status of their wealth to become moot once AGI hits. Most likely this will come in the form of artificial barriers to using AI that, for ostensible safety reasons, makes it prohibitively difficult for all but the wealthiest or AGI-lab adjacent social circles to use.
This will cause a natural exacerbation of the existing wealth disparities, as if you have access to a smarter AI than everyone else, you can leverage your compute to be tactically superior in any domain with a reward.
All we can hope for is a general benevolence and popular consensus that avoids a runaway race to the bottom effect as a result of all this.
I worry that those who became billionaires in the AI boom won't want the relative status of their wealth to become moot once AGI hits. Most likely this will come in the form of artificial barriers to using AI that, for ostensible safety reasons, makes it prohibitively difficult for all but the wealthiest or AGI-lab adjacent social circles to use.
This will cause a natural exacerbation of the existing wealth disparities, as if you have access to a smarter AI than everyone else, you can leverage your compute to be tactically superior in any domain with a reward.
All we can hope for is a general benevolence and popular consensus that avoids a runaway race to the bottom effect as a result of all this.