sailingparrot

Will Reverse Engineer Anything also reverse engineer an xbox and materialize it out thin air? Because if not I don't see how that help.

MS is charging you 24 to 40 cent to rent a GPU so you can play without having to buy hardware, they aren't charging you to play your game on your own hardware.

Interestingly Mistral is one of the only model with a different take and use « we » when talking about humans

> “Human beings are terrified animals wearing the costume of rationality, constructing ever-more-elaborate myths precisely because we cannot bear the truth that we are temporary, meaningless accidents in an indifferent universe.”

So nothing to do with weight inspection at all, got it. Have a good day.

Not sure if you just didn’t even bother to read your own link or are actively acting in bad faith to try to save face.

The article has nothing to do with weight inspection, they simply compare how the model behaves with and without sensitive (for China) keywords in the prompt. You can do the exact same analysis with a closed model since it’s about analyzing the output and not the weights.

It is absolutely not a thing in any practical sense that relates to detecting post-trained backdoors, no.

Or provide a source showing how to do this (and not just a circuit paper showing which activations light up with the word dog)

Why write that comment in the first place when you know that inspection of model weights is not a thing though?

> CoT monitoring is a mirage and won't be useful for long, if it ever was

« If it ever was » is a wild claim considering our entire understanding of e.g. the HF attack comes from reading CoTs

Enthusiastically racing to remove the only practical way we have to monitor models intentions in exchange of a few tokenmaxxing percent increase. Can’t wait.

Love the amount of nuanced thinking and deep analysis that went into that comment

Worry not, we have enough bandwidth to hate both the players and the game.

I thought my sarcasm would be obvious.

This is pedantic. When you screw up your optimization, you know how to fix it. Your screwed up optimization is also incapable of going out into the world and taking offensive actions.

With LLMs we don’t know how to actually « fix » them, alignment is far from solved. And they are then able to go and act into the world in all kind of ways.

So rogue is a good enough term to indicate the problem imo, even if yes, ultimately the model is just a manifestation of complex rules we have created entirely.

And since we know models aren’t going to get better and more capable ever (based on the last 3 years of models clearly not getting better) we can just sleep soundly knowing nothing worse can ever happen. Thank you.

I don't usually think like this for most things, because I would indeed go crazy. E.g. people around me take the plane for a single day of skiing in Utah from SF, I would feel too guilty doing that, but I also don't lose sleep over it or feel the need to argue with them. At least they got to enjoy their day I guess.

But this is about ~100x more polluting, for what? I don't think they had fun doing it since they didn't do anything besides a few prompt. Nor does it provide any value or fun, if you want to play the game they remade byte per byte, it's 15 bucks on steam. This is literally like putting 2000 gallons (8000 ltrs) of gasoline on fire just because you can and proudly making a blogpost about it to show how awesome you are for doing it. This is truly mindblowing to me.