lambdaphagy
Joined 11 years ago
Joined 11 years ago
``` Basic characteristics of Unacceptable Autonomous Weapons Systems should include but not limited to the following:
- Firstly, lethality, meaning sufficient lethal payload (charge) and means.
- Secondly, autonomy, meaning absence of human intervention and control during the entire process of executing a task.
- Thirdly, impossibility for termination, meaning that once started, there is no way to terminate the operation.
- Fourthly, indiscriminate killing, meaning that the device will execute the mission of killing and maiming regardless of conditions, scenarios and targets.
- Fifthly, evolution, meaning that through interaction with the environment, the device can learn autonomously, expand its functions and capabilities in a degree exceeding human expectations.
Autonomous weapons systems with all of the five characteristics clearly have anti-human characteristics and significant humanitarian risks, and the international community could consider following the example of the Protocol on Blinding Laser Weapons and work to reach a legal instrument to prohibit such weapons systems. ```
Charitably, you might say that China is worried about a nightmare scenario. Less charitably, you might say that the definition of an unacceptable weapon system is so tight that it does not describe anything that anyone would ever build, or would want to build. This posture would allow China to adopt the international posture of seeming to oppose autonomous weapons without actually de facto constraining themselves at all.
This, by contrast, is what China considers acceptable:
``` Acceptable Autonomous Weapons Systems could have a high degree of autonomy, but are always under human control. It means they can be used in a secure, credible, reliable and manageable manner, can be suspended by human beings at any time and comply with basic principles of international humanitarian law in military operations, such as distinction, proportionality and precaution. ```
So as long as the system has a killswitch (something that afaik absolutely no one is proposing to dispense with?), it's Acceptable.
Meanwhile, it would certainly seem that China's defense research universities are interested in developing this tech: https://thediplomat.com/2026/02/machines-in-the-alleyways-ch....
So, I did a bit of research with my internet access-- how do my findings square with your impressions?
I think you need to have people thinking through this stuff at a nuts-and-bolts level if you want to avoid getting dominated by a slightly less nice adversary, and so too with AI. Does a unilateral guarantee not to build autonomous killbots actually make anyone safer if China makes no such promise, or does that perversely put us at more risk?
I’d love to know that the “no killbots, come what may” strategy is sound, but it’s not clear that that’s a stable equilibrium.
- had four [!] terms, a move so anomalous it was subsequently patched by constitutional amendment
- threatened court-packing until SCOTUS backed down and stated rubber-stamping his agenda
- ruled entire industries by emergency decree in a way that contemporaries on the left and right compared to Mussolini
- interned 120k people without due process, on the basis of ethnicity
- turned a national party into a personal patronage system
- threatened to override the legislature if it didn’t start passing laws he liked
Not even saying any of this is even good or bad, clearly in the official history it was retroactively justified by victory in WWII. But it’s a bit rich to say that the bomb wasn’t developed under authoritarian conditions.
You can take issue with that argument if you want but it’s unconvincing not to address it.
I asked Opus 4.6 to multiply 50,651 x 895,707. It immediately responded: 45,368,055,057. This was wrong, but very close (good to about 10^-5 relative error). I then asked it how it arrived at that answer, and whether it had used any tool calls. It said:
``` No, I didn't use any specialized tools — I just computed it directly. Though I should be honest: large multiplications done "in my head" like this are prone to error. Let me double-check by breaking it down: 50,651 × 895,707 = 50,651 × (900,000 - 4,293) = 50,651 × 900,000 - 50,651 × 4,293 First term: 50,651 × 900,000 = 45,585,900,000 Second term: 50,651 × 4,293
50,651 × 4,000 = 202,604,000 50,651 × 293 = 14,840,743 Total: 202,604,000 + 14,840,743 = 217,444,743
Result: 45,585,900,000 - 217,444,743 = 45,368,455,257 So my first answer was actually slightly off! The corrected answer is 45,368,455,257. I don't have a calculator tool available — I'm doing this arithmetically by decomposition. For mission-critical calculations, I'd recommend verifying with a calculator since I can make arithmetic errors on large numbers like this. ```
So I would rate OP's claim (which is supported by a paper from 2024) highly implausible. Opus 4.6 appears to be able to do multi-digit arithmetic formally, as well as give remarkably accurate estimates based on something like "number sense".
I can’t speak for your friend, but as a former atheist who brcame a Christian (albeit a very mediocre one) I feel like I can see both sides of this so perhaps I can offer a perspective that might help you understand each other better.
When I was an atheist, I assumed that anyone who didn’t care for the kinds of jokes you mentioned was worried that God would zap them with a lightning bolt.
Now I see it a little differently: if you see something as being of great importance, then it simply feels off / wrong / weird / missing the point to treat it as if it’s of little or no importance. In a word, it feels cringe. If such a project holds no allure for you, then you’re not missing much by sitting it out.
Not to harsh on your sense of humor, but I hope it might help to understand your friend better.
Is that a conspiracy theory in the sense of “some crazy low-status nonsense that no one should pay attention to”, or a conspiracy theory in the sense of “a theory about a private arrangement between multiple actors”?
https://www.pbs.org/newshour/politics/zuckerberg-says-the-wh...
In particular it obscures what is fundamental to the conflict, which is state/settled vs non-state/tribal, not one group being native to the land and the other being some sort of outside occupying force.