tkanarsky
Joined 4 years ago
Joined 4 years ago
YouTube channel that published a video series analyzing the Surfside condo collapse now goes over what is claimed to be a leaked transcript of text communications with the doomed OceanGate submarine mission.
Submarine descends too fast, ~38m/min instead of ~25m/min. Support vessel notes discrepancy, sub presses on with descent.
At 9:28a, hull monitoring alarm sounds. Upward thrust is commanded to no effect. Ballast released to no effect. Landing frame released after several attempts, but ascent rate 1/4 of planned.
At 9:38a, crackling sounds heard in aft of ship.
At 9:46:37, power bus A reports failure. Crew switches to power bus B. More sounds heard. This is the last communication received by the support vessel.
-------
If this is authentic, then it basically confirms gradual delamination that snowballs into catastrophic implosion. It's horrible that the crew knew things were going wrong for nearly nineteen minutes and could not do much about it.
And how would you quantify alignedness? Rating outputs for a given input falls prey to the first problem. Analyzing activations as they trickle through the model is intractable analytically, and training a "polygraph" model on the activations of your network raises more alignment issues (how can you be sure the polygraph isn't lying to you?)
I'm ready to eat my words, but I think perfect alignment is infeasible. The best we can hope to do is curate training data and hope the caged bird won't sing.