> Grey goo. The Borg. Skynet. ...
You're reasoning from fictional evidence, like the people who wanted to ban heart and kidney transplants because they'd watched Frankenstein, or who feared computers because they'd watched 2001.
Self-reproducing machines are dangerous in the same way that ammonium perchlorate, natural gas, electricity, or computers are dangerous: people can use them to do bad things, and people can engineer systems carelessly, causing accidents.
https://en.wikipedia.org/wiki/PEPCON_disaster
https://en.wikipedia.org/wiki/New_London_School_explosion
https://en.wikipedia.org/wiki/War_of_the_currents#Safety_con...
https://electricenergyonline.com/energy/magazine/362/article...
https://en.wikipedia.org/wiki/Morris_worm
What is called for is adequate respect for the capabilities and risks of the technology you're working with, prudence in preventing accidents, and avoidance of extreme technological power imbalances like those that led to the Congo Free State and the Google Play Store, not the sort of puerile irrationality that privileges Gene Roddenberry's ideas over those of John von Neumann.
You're reasoning from fictional evidence, like the people who wanted to ban heart and kidney transplants because they'd watched Frankenstein, or who feared computers because they'd watched 2001.
Self-reproducing machines are dangerous in the same way that ammonium perchlorate, natural gas, electricity, or computers are dangerous: people can use them to do bad things, and people can engineer systems carelessly, causing accidents.
https://en.wikipedia.org/wiki/PEPCON_disaster
https://en.wikipedia.org/wiki/New_London_School_explosion
https://en.wikipedia.org/wiki/War_of_the_currents#Safety_con...
https://electricenergyonline.com/energy/magazine/362/article...
https://en.wikipedia.org/wiki/Morris_worm
What is called for is adequate respect for the capabilities and risks of the technology you're working with, prudence in preventing accidents, and avoidance of extreme technological power imbalances like those that led to the Congo Free State and the Google Play Store, not the sort of puerile irrationality that privileges Gene Roddenberry's ideas over those of John von Neumann.