Strictly speaking, according to Bostrom, the kind of machine-based intelligence that is heading humanity’s way wouldn’t wish its makers harm. But it would be so intent on its own goals that it could end up crushing mankind without a thought, like a human stepping carelessly on an ant.
Like corporations.
What happens when computers get good at management? A network of computers may be able to outperform human managers. Even if they're not quite as smart as the smarter humans, a network of computers can coordinate better than a meeting of people. Once computer-run companies start producing better returns than human-run ones, the computer-run ones will dominate. That's basic capitalism.
This doesn't imply that the organization is entirely automated. It just means humans aren't at the top. If it produces more profits, companies will be forced by investors to take that route.
Like corporations.
What happens when computers get good at management? A network of computers may be able to outperform human managers. Even if they're not quite as smart as the smarter humans, a network of computers can coordinate better than a meeting of people. Once computer-run companies start producing better returns than human-run ones, the computer-run ones will dominate. That's basic capitalism.
This doesn't imply that the organization is entirely automated. It just means humans aren't at the top. If it produces more profits, companies will be forced by investors to take that route.