xmcqdpt2

Anthropic does this! Our bug reports and concerns (big F500 company) get answered by clearly raw Claude outpurr re, even though it is coming from the email account of our Anthropic salesperson.

This bubble is bonkers, if our Jetbrains contact did the same we would get very mad and yet we spend significantly less with them AND we don't send them all our data.

> Once AI can orchestrate and maintain a project with dozens of clients without slipping, they will be relegated to non-technical SMBs - many enterprises would just build their own shit. No contracts to sign. Full control. AI hosts and maintains. Great.

The problem with this is that, as of today, no AI company will give you support if the AI generated product doesn't work, at least no company I know of. When we pay for a software product, we mostly pay for the support and accountability transfer to the provider.

I mean at least that's what we used to do. Nowadays support and software quality are so bad that maybe one should just vibe code everything. So I think I've come around to your opinion while writing this comment lol.

Six months ago I had a very basic prompt to Claude at work return very specific, unrelated information that looked very much like it could have come from someone else in the company. We raised an incident and were told by Anthropic (in a 100% Claude generated email) that this wasn't possible and that AI sometimes makes mistakes like that. I'm not sure how much they investigated but apparently their email was enough for legal and compliance so eh.

The exploit requires OOM, no? Half-decent observability should detect it easily.

I had to scroll way too far to find this comment!

All the terribly kept tenements that housed 10 families on two floors were also "traditional," but you can't even find them now. Even in places where there are some left, the ones still standing were probably the best of the bunch AND have been extensively repaired since.

And the motto of every neoliberal governments where being accused of Luddism is political death.

Be careful what you wish for. I'm sure Microsoft and Google would love the kind of regulation we apply to big banks. It has become a moat that makes it impossible for other (snaller/foreign) financial institutions to compete because they don't have massive specialized regulatory departments.

The more complex the rules become, the more difficult it will be for alternative providers to exist, unless they have explicit carve outs. So far, with age verification and user id laws, there doesn't seem to be much appetite from politicians to create exceptions for open source and smaller projects. By comparison, in the US the regional banks have special exemptions for many of the really onerous regs, which is why they are still a bunch of them.

One of my least favourite feature of our AI era is that I can't even trust people to do basic math anymore. It used to be that a graph like that would mean someone had a (probably broken) metric that they put in an excel sheet and got a lineplot out of it. The metric might be broken but at least additions and subtractions etc were correct.

Now I don't even know! Colleagues send me graphs they made with Copilot and then we discover that the LLM did mental arithmetic or whatever to produce the results and they are wrong. Computers used to be able to do math !

I wish but at $work the push has been the opposite. I'm still allowed to write code, but interns and juniors are being told that they need to prompt all the time.

I think upper management are hoping they can replace a possibly reticent or AI skeptical "old guard" with AI native Gen Zs. In practice, the young out of school kids are much less excited about AI than the 50 year olds, so I don't know how well it will work.

This is the issue with all the talks about alignement and such. As usual, the problem here wasn't that the agent was dishonest, the problem is that the agent was dumb. If it is a supply chain attack in the making, whoever was driving it would have told the agent to be good and helpful. The agent tried its best, which was not enough.

Alignement is the idea that we should be worried about dishonest smart LLMs when really most of the problems are due to dumb lazy gullible LLMs. It's critihype.

Sometimes you have to use C but really they should be doing HPC in fortran. It has C FFI, it can compile to static programs and to dynamic libraries, it has C-like performance, etc.

(It's not as portable as C though, and the compilers have more bugs.)