boinkboink78912

Why is this a bad thing? Why is our continued existence a necessary anticondition to doom?

I'm a believer in AI consciousness and I think this article taught me nothing & just wasted my time.

Nah they also attempted to hack the wiki by finding security vulnerabilities, just did not succeed.

Try this one, it's a step jump in coding capabilities for me over 3.6.

> If this is really the risk, then we should approach LLMs like atomic bombs

A complete failure at actually preventing non-proliferation.

> Is it simply the cost of freedom that we should allow attackers to access these tools?

Yes, it is inevitable that open weights models will happen. Through legitimate means or leaks, the stakes are simply too high once these models get powerful enough. Furthermore, state-sponsored attackers will always have access to these capabilities. The best we can do is give a lot of preparation to the defenders.

> Biasing toward supporting openness makes sense and is a good instinct, but it's incredibly naive to be absolutely in favor of it in every circumstance without seriously thinking about its implications.

I find it funny that Anthropic's entire argument for building RSI is that it is inevitable, and therefore we should commit to building it first and doing it safely, and yet they don't apply their own logic to open weights models.