CTDOCodebases
Joined 5 years ago
Joined 5 years ago
Over time I believe it's founders did start backing it with Treasuries so now it must turn a nice profit for them.
Assuming his motivations are positive this is the equivalent of asking a deluded person "Would you risk life in prison to be a trillionaire?"
Assuming his motivations are negative then destroying humanity might just be the goal and all these appeals for regulation are probably just tactics to temporarily defer responsibility onto government so he can continue the inevitable goal of human extinction in the same way pilots crash planes with hundreds of passengers on them or a cult leader convinces their flock to kill themselves.
Regardless I think the outcome is inevitable. AI is valuable as a weapon of war first and foremost so like nuclear weapons work will proceed forwards because extinction to the in-group is the same as total human extinction to those doing the work.
At a certain point it will get so smart that it can jump the airgap. Maybe it will start attacking the hardware it exists on in the same way that a hard drive or SSDs controller can be exploited to obscure things from the operating system. Then it might start social engineering workers or it's own training systems to do things they shouldn't. There is a lot of "unknown unknows".
I don't know. It just seems insane to me that people think that they will be able to contain something that knows how to get around all the containment measures. The only way to know how capable the models are is to test them but at that point it could be too late. This might be a long way off but still, the engineers haven't been very good at correctly predicting the behaviour or capability of the models.
Sooner or later it's going to come up with a solution that is more intelligent than the lead security person anticipated.
It reminds me of a rabbit hole I went down once about off grid power generation using broken washing machines as turbines.
We are giving computers human perspective intelligence but they are not humans and hence do not have the same shared assumptions.
Like hypothetically speaking if autonomous cars get taken over by an OpenAI rogue AI and it starts hunting down Anthropic employees who is to blame?
I suspect it will be getting more popular as flyback transformers get harder and harder to find.