sealeck
Joined 5 years ago
Joined 5 years ago
That’s why large tech companies are lobbying in favour of this!
Isn’t this the problem inference (training) a model is designed to solve :)))
Usually the objection is that "oh well, the computer can be used for many great things", which isn't particularly satisfying because, um, we can use AI for "good" (better?) things as well (e.g. trying to find novel cures, unlocking the mysteries of protein folding, etc etc).
Then the objection becomes something like "well the computer is here and we have to live with it", which is also now true of AI. Do I like the "it's inevitable" argument; no, but it's clearly very true that we do have the transformer, that won't go away - where we DO have control (or should seek to change) is the organisational structures that we as a society decide to create, and how we safeguard the dignity of the individual in changing times.
We are also concerned that it may not be possible to bind OpenAI using contract terms and/or the US legal system.
I think there's an interesting phenomenon where it is _not_ the people who control it, but instead a kind of international finance man cum-captain of industry (perhaps best embodied by Sam Altman) who does not create the technology and yet has ended up wielding the levers.
What if there are bugs in this C,Rust->Lean compiler? Anthropic are able to sidestep this by reasoning at the RISC V level for which its easier to develop a correct semantics.