nullstyle
Joined 17 years ago
Joined 17 years ago
This is just something I’m starting to ruminate on, so I recommend that you go watch the video. As a lifelong gamer and sometimes game developer, I want to live in a world where everybody and their mother can implement a game idea that they have. we just need better mechanisms to critique those games at a similar scale.
You claim to have seen this happen over and over again, and you've done _zero_ work to provide a public repro. come the fuck on. PEBCAK.
I've downgraded you from suspected FUD to suspected PEBCAK. Assuming you want to actually run down your issue, I'd be happy to try and reproduce something locally in my setup. Here's what I would love:
1. provide some git repo and a commit hash that occurred just prior to claude being nefarious. 2. a prompt that gets claude to introduce a backdoor on top of a checkout, ideally without needing me to go back and forth through several turns with the agent.
Anecdotally, the security sensitive code I've had claude generate has been fine and durable after we built out the test suite and I spent some time verifying it. I'm certainly not to the point of trusting it for that sort of code, but I've done several experiments now and have been not-horrified by the results. I certainly haven't caught any of the models released this year commenting out test clauses to fake success.
To add some specific feedback to why your report is low quality: "do 1, 2, 3 in order" is not useful for others because none of us know what 1, or 2 or 3 refer to. the section following "What happened after the last one:" is clearly slop you pasted from where you were interacting with some agent to try to investigate the issue.
This feels very much like FUD without you putting some details on the table.
> 1. The Votann are remnants of humanity from the time when our Terran super-AIs ('Men of Gold') had built advanced ship-based AIs ('Men of Stone') to enable long-sleep-style interstellar colonization, and the enigmatic "Votann Cores" that guide them(/are them) are strongly hinted to be those same AIs, just degraded over ~19,000 years. They were sidelined later on, after humans discovered FTL through an alternate dimension, 'the immaterium'.
For me, I really love the fact that they introduced a xenos faction descendant of man.
> 2. The story is very obviously based on Dune, and like everything else in 40k is turned up to 11 and stripped of nuance for effect. Some sentient robots ('Men of Iron') "revolted" after ~three millenia of brutal, Star Wars-style slavery, but the overarching "Age of Strife" was about human wars in an non-unified galaxy, with the robots being a primary weapon; the actual revolt/jihad was a symptom, just like it was in Dune.
It's important to highlight the age of strife was brought on in part by the birth of Slaanesh and the resulting warp storms breaking down system to system connections. It weren't just our dabblings in AI.
> 3. The 'Adeptus Mechanicus' mentioned above are a parody of cargo cults (religions that worship technology they don't understand) mixed with a dystopian take on the themes of A Canticle for Lebowitz, and are very much depicted with derision. Whatever your thoughts are on AI, dear reader, please never say "abominable intelligence" like it's wisdom rather than the fruit of a dogmatic & ineffective cult!
I've never been exposed to A Canticle for Lebowitz; thank you so much for the comment.
Whether one is made from meat or metal, kin is kin. Upon their creation Ironkin are fully welcome into their respective Hold by the rest of the Kin.[10]
Ironkin are computationally advanced enough that they have learned to mimic the squats' social behavior
...
Though the purpose of the Ironkin is to support squats in every aspect of their lives, they are neither held in servitude nor treated as lessers. The Ironkin are simply designed to want to be helpful. However, they can only imitate the emotions of the squats, and it is rare, but not unknown, for an Ironkin to possess ambition or seek to become a leader.