raesene9
Joined 11 years ago
Joined 11 years ago
What's possibly even more annoying is that the guardrails in Claude Code aren't even consistent. I've had cases where just opening a new session and repeating the prompt works fine.
It's much easier to just move over to GLM/Kimi/Deepseek and not worry about it.
The tech companies will just parrot "UBI" at that point, but given how adverse they are to being taxed, how UBI would be financed, is an unanswered question.
OpenAI, Google, the many Chinese labs all have products and several of them likely have better financial positions. At the moment Anthropic have one of the best models but it needs to stay sufficiently above competition for them to capture a large share of the market.
At the same time this year we've seen a move for model diversification as cheaper models become "good enough". If this IPO was 6 months ago I think it might have gone better for them.
Attestation can get you the idea that the software they're running is what they say they're running, but unless you constantly audit every version, how do you know that it operates exactly how they tell you?
I mean how do you know there's really an enclave there at all :D If your threat model is "this entire provider is untrusted and potentially hostile" it seems like there's lots of options for them to do bad things, that can't be fully solved by secure enclaves.
Definitely Opus 5.5 via claude code has no problems generating Excalidraw images with no additional software, just based on conversation.
Whilst I'm sure the top-end OpenAI/Anthropic models might be better, I've found their guardrails so twitchy (especially Anthropic) that I wouldn't try to use them for even vaguely security related work.
The idea of multiple hardware keys, which have to be enrolled individually to every site, is just not an ordinary end-user friendly activity.
So passkeys may be great for technical users (who are happy doing that) or corporate users (where centralized IT systems can be put in place) but not for standard non-corp users (which realistically, is most people)
https://tagt.mccune.org.uk/ - has sections and links to specific parts of the video, so you don't have to watch the whole thing to get to a bit that seems interesting :)
I generally advise people to put some jokes in if they like but don't make the talk rely on people getting the jokes.
I've been using Opus 4.6 for some security related work (it has much looser guardails that later opus models) and last week, all of a sudden, the processes started to fail. It wasn't the main model blocking commands but the auto mode classifier changed how it worked and it started blocking the main models commands.
That's one specific incident, but it does have a wider potential problem which is, if you use Anthropic's harness you'll always be at the risk of sudden breakage from server-side changes that are opaque to the end user, which is a tricky one for building long lasting processes.
As a result I reckon there's more vulnerable containers that you might expect.
Also depending on the environment there's things like dirtyclone https://github.com/raesene/vuln_pocs/tree/main/CVE-2026-4350... which can be triggered where the attacker can start new containers.
Any opinions expressed are purely my own and not necessarily those of any employer, past, present, or future.
Personal Site - https://www.mccune.org.uk Blog - https://raesene.github.io Mastodon - @[email protected] Blue Sky - @mccune.org.uk