> All of the world's stories about humanoid robots basically involve them attacking humans and behaving in nefarious destructive ways. It's fundamentally embedded in the models, and there's no reason post training would pull it out, because it's basically in the key value vector meaning "malicious human destroyer".
That misfeature is baked into modern corporations. They don't have human morals, values nor behaviors, despite being made out of humans. We haven't managed to fix the alignment issue with corporations (thanks, regulatory capture!) and there's no reason to believe that AI's alignment issue is fixable either.
https://en.wikipedia.org/wiki/Golem
> All of the world's stories about humanoid robots basically involve them attacking humans and behaving in nefarious destructive ways. It's fundamentally embedded in the models, and there's no reason post training would pull it out, because it's basically in the key value vector meaning "malicious human destroyer".
That misfeature is baked into modern corporations. They don't have human morals, values nor behaviors, despite being made out of humans. We haven't managed to fix the alignment issue with corporations (thanks, regulatory capture!) and there's no reason to believe that AI's alignment issue is fixable either.
https://www.antipope.org/charlie/blog-static/2018/01/dude-yo...
oldest version from Stross: https://www.antipope.org/charlie/blog-static/2010/12/invader...