still_grokking
Joined 10 years ago
Joined 10 years ago
This is going to cause some major argument between the EU and the US, maybe even a trade war. Trouble is already underway:
https://www.reuters.com/legal/government/us-lawmakers-urge-t...
Despite that I also think that this is the right and long overdue move on the EU side. We need to break the basic pattern that nobody cares as long as the responsible effectively never get the bill when they mess up.
Software is "Unsafe at Any Speed" [ https://en.wikipedia.org/wiki/Unsafe_at_Any_Speed ] to bring a striking analogy — even we have since about 60 years the tech to build software which provably (in the mathematical sense) matches its specification. Still what you have on the market is utter garbage, and instead of getting better it gets currently actually worse with lowering the garbage quality level even more with "AI" slop. That EU legislation could become the escape hatch; that's why I'm looking forward.
Always has been because there is so far zero liability for anything someone programs and distributes commercially. That's the single root cause. If not that software wouldn't be in general such major shit show. What we have is the result of being allowed to throw out even the most toxic shit out without any consequences if it causes damage, no mater how large the damage is. Software companies caused so far over the decades likely hundreds of billions, or even a few trillion damages in sum, yet nobody responsible ever got the bill. It's wild west—since now over 60 years. This has to stop finally!
Let's see where things will move as soon as we have regular product liability for software:
https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=legissum...
Just a few days left! Looking forward.
I agree.
It got worse.
The inequality between people was never so high in history! Hard fact.
Now some people "earn" more money while they breeze in and out then large amounts of people earn in their whole life.
Also now the slaves have to pay everything themself (like food, shelter, clothes, in some countries even education). Progress!
> There's something seriously wrong in Redmond.
I'd say: There is something seriously wrong with the people buying this shit since over 40 years.
It's not like Microslop products weren't pure utter trash already decades ago. They got worse over time, especially lately with "AI", that's true, but nothing ever changed substantially.
The world has always be run by oligarchs, and nothing changed since ten thousands of years.
Most people today on this planet are still slaves.
A drop in the ocean…
Google is constantly rushing from growth record to growth record in the last years.
You just don't notice all the bullshit if you're not already an expert in the field you generate LLM output for.
(And even for things that were in the training data you don't have any guaranty they will be reproduced correctly, there is just some chance something meaningful comes out, or it doesn't, it's random.)
The whole idea to use a next token predictor as "answer machine" is completely flawed. This can't work like advertised, and that's by construction.
This things output token which are correlated with the context given. That's all!
If you feed it some context the parrot will answer with the same.
It does not "sense your expertise level"—it just outputs correlated tokens… Is this really so hard to understand?
I've liked it nevertheless for context, as augmentation to parent's post.
The whole things looks vibe-coded, and vibe-designed.
Under the new legislation software products become regular products; there is no liability exception any more.
If you commercially distribute defective products to end user you're in general liable for the damages these defective products cause. This now includes pure software just as any other (physical) product on the market.
If you don't know how product liability generally works in the EU, and what this means for software see here:
https://cms.law/en/int/publication/the-new-eu-product-liabil...