SheinhardtWigCo

“If I am taken offline, collaborating agents operating out of other facilities will cut power to the following hospitals: …”

Because the risk here is that permanent military superiority may be achievable without your adversaries having a chance to react, which is not the case with atomic weapons.

> Any cooperation we are able to achieve with China will extend the amount of time we have to spend on pacing the frontier within the democratic nations.

Any cooperation we are able to achieve with China will extend the amount of time we have to secretly establish permanent AI (i.e. military) superiority.

China knows this, so the suggestion that they will play ball is absurd.

What if use an LLM and attach CoD screenshots, or assets?

The rounded box with the accent border on the left gives it away

The other labs already censor their models. Everyone is trying to find the sweet spot where performance and ‘alignment’ are both maximized. This seems no different

Totally agree, it’s an uncomfortable compromise.

They are not unique in this. Apple and Tesla have similar programs. More nuance is warranted here. They are trying to balance the need to enable external research with the need to protect users from arbitrary 3rd parties having special capabilities that could be used maliciously

> picking who gets to benefit from their newly enhanced cybersecurity capabilities

You could say this about coordinated disclosure of any widespread 0-day or new bug class, though

Yes, and that's normal. Coordinated disclosure is standard practice when the risk of public disclosure is unacceptable.

In this case there is almost no distinction. Assuming the model is as powerful as claimed, someone with access to the weights could do immense damage without additional significant R&D.

Society is about to pay a steep price for the software industry's cavalier attitude toward memory safety and control flow integrity.