Let's say that we are "pacing the frontier", and an approved model goes and causes billions of damage, or worse, loss of life. The auditor signed off on the model, so who is to blame? Who put their akin in the game? METR did. The public did. But it seems like the lab has crafted a system in which they remain blameless.
The calculus of risk is fundamentally different when the adverse consequences are obvious and tangible.
I don't see how some federal agency or external auditor will do anything to align incentives. It just seems like a way to socialize the risk while holding onto the benefits to me.
The calculus of risk is fundamentally different when the adverse consequences are obvious and tangible.
I don't see how some federal agency or external auditor will do anything to align incentives. It just seems like a way to socialize the risk while holding onto the benefits to me.