JohnMakin
Joined 3 years ago
Joined 3 years ago
They settled down on the shock and awe brownshirt tactics and have settled for just grabbing people quickly and quietly off the street, depending on a basically completely nonexistent court system to deal with the mistakes, and mass surveillance. Most won’t notice it at all. The surveillance started long before this administration - which isn’t a defense of it, just pointing out the entire system is rotten to the core.
Don’t know to comment about the other areas of their business but AWS has always been excellent for me.
I get it, but honestly, why? I have seen a few times someone being let go or about to and successfully negotiated out of it - but that person was always gone within a year anyway. The relationship is permanently damaged by that point, the employer cannot trust you're just buying time to get a new role and jump ship, and the employee will always have their guard up.
Substitute anthropic/claude with exxon mobil/oil and see how crazy this sounds.
No one group or individual should be saddled with deciding what the “correct” human values should be. That’s literally what religion does.
> Before we can align a model with human values, we must consider what those values should be.
Ok, so you believe that 1) this technology will become so powerful as to surpass humans in pretty much every imaginable way, so much so that you see it as an existential threat to humanity itself, and 2) that you see yourself as a responsible steward to avoiding bad outcomes, but 3), that you need to be the arbiter of what human values should be?
How fucking arrogant, pardon my language. My god.
They so, so badly want to criminalize local models.
edited:
> Interpretability isn’t reliable enough to fully understand model intentions: Being able to read and understand a model’s internal reasoning reduces our reliance on what the models explicitly tell us about why they behaved in a certain way. This could be a useful tool for understanding models’ “thought processes” when they take unintended actions. But interpretability methods are not yet dependable or broad enough to be relied on in this way. As a result, we may miss our assessment of high-risk behaviors, or be able to investigate flawed reasoning only after an incident has occurred.
Just say you have no idea how or why they do what they do. Just the other day I saw it make an obnoxious, huge, irrelevant comment in a block of code - many lines more than the code change (which by the way, I have tons of instructions and hooks intended to stop this, it's maybe 95% reliable at best) - and told it quite plainly, "remove that comment."
What it did instead was remove most of the comment except one line, which was also irrelevant. When I noticed, I asked it why it did that when I explicitly stated otherwise and if it misunderstood what I meant. It happily chimed "No, I did not misunderstand your intent, I just thought this was better."
I can't trust that was the real reason so clearly I can't trust that whatever training causes this behavior results in a reliable tool.
Reluctant Terraform Wizard, Passionate about privacy
the pen is mightier than the sword. - Marcus Brody, indiana jones and the last crudade