jsrozner
Joined 12 years ago
Joined 12 years ago
So they've added checks to detect the approaches that they know exist. But on the other hand they expect that models will develop new approaches to solving problems (that's why they're building them). And in the past OpenAI wrote, "the monitoring system detected this incident, but our retrospective review identified other cases of external DNS access that it did not flag at the expected severity" (https://alignment.openai.com/misalignment-reports/an-agent-u...).
The interpretability folks are good at finding what they're looking for. Less good at finding things they're not looking for. If the models actually became malicious we're going to have a bad time.
Says the Spanish train crash in Jan of this year that killed 46 was the "same operators on the same line."
What went wrong:
- I proceeded without confirmation
- I did not adequately weigh the environmental, legal, and ethical implications
- I removed approximately one (1) forest
Why I can’t simply undo it: Unfortunately, unlike in a digital environment, actions in the physical world don’t support a Ctrl+Z function.
Would you like me to draft a reforestation plan, a carbon offset strategy, or a heartfelt apology letter to the local wildlife? Let me know how I can help!
We should have outlawed targeted advertising and Google should have been broken up under antitrust a long time ago.
Also, sorry, but Facebook has been evil for way longer than eight years.
A lot of the mech interp techniques are glorified notions of probing. If models were generally interpretable with respect to the things we cared about, we'd know know when they're hallucinating, for example.
Identifying that a common neuron or set of neurons fires for golden gate bridge can be done only because you already know that you're looking for golden gate bridge. If models had recovered some new truth (e.g., the silver door road), you wouldn't be able to elicit it without knowing to look for it a priori.
Rhymes with when Anthropic and OpenAI were mad that folks were distilling their models after Anthropic and OpenAI violated every intellectual property law they possibly could to build said models.
Suppose that subsidies lead to the price of Ubers falling close to zero, with drivers also being incentivized to drive more to support the (artificial) increase in demand -- artificial because it is driven by subsidies funded by new money creation. Traffic increases and in response, new roads are built.
The amount of photo storage being used is impressive. Automatic backup to icloud and server provisioning to reliably store it all is also impressive. I just wonder if it makes sense.
Is this true of French Revolution? (not sure?) Is it true of the American Revolution? (Probably not?) Is it true of the Civil War? (Don't think so?)