DrBazza
Joined 13 years ago
Joined 13 years ago
An interesting side effect will be whether we accelerate moving towards memory safe languages (and development of more of those languages) in more sectors than just 'low-level'.
Not forgetting that this is only one mitigation of cyber-attacks and exploits and potentially removes a whole category of attacks developed by analyzing *source code*
I click close at least once a day and close the window and not the sidebar that popped out. Windows, KDE, and Gnome don't do this.
--
Two men who fell seriously ill following a clinical drugs trial remain in a critical condition but four others are showing signs of improvement.
All six are still in intensive care in Northwick Park Hospital, north-west London, after falling ill on Monday.
TeGenero, which manufactures the anti-inflammatory drug, says it has apologised to the men's families.
Also the article starts with an implicit assumption of survivorship/observational bias, the title being 'Why were Victorian elites so effective?' - the assumption that they really were 'effective' or was the rest of the world simply worse and they were simply the 'least worst'? That line of enquiry was not even discussed.
It ends with this American-centric paragraph:
> Would modern societies work better if their local and national government were conducted by a tight-knit community of extremely rich and successful people? Maybe not: the downsides are obvious. But the problems would be interestingly different from those that they have in reality. Imagine a San Francisco whose Board of Supervisors featured Jeff Bezos, Larry Page, Sam Altman and Mark Zuckerberg, each feeling this responsibility to be the greatest glory of his career, each hoping that he might one day attain the greater glory that is the House of Representatives. It might not be paradise. Maybe it would be a disaster. But it would certainly be interesting.
Well, the Chinese Politburo is 21 people that run a country of (maybe) 1bn people. The progress of China and the lifestyles of a billion people over 40 years is pretty remarkable.
Compared to the dotcom boom, firms are well positioned in terms of capital - they have revenue and profits.
However, there's still the absurd speculative valuations, risk, and high expenditure (on said data centres). Also, Andrew Bailey from the Bank of England, personal opinion - https://www.bbc.co.uk/news/articles/cv8e30enrkxyo
sourcehut's 128kb raw, and 28kb over the wire.
codeberg is 420kb raw, and 66kb over the wire.
But not the point of my comment. Computer programming has been a progression of physically wiring up valves, to soldering transistors, to punched cards, assembly, then higher level languages. Now we have natural language models.
The analogy being each that most people don't care about the assembly generated as the code works and it's really performant/efficient. Humans can still optimise assembly, but there's vanishingly small marginal gains for all but the most intensive/low-level tasks.
If LLMs produce things that work, and are indistinguishable from a careful human programmer (i.e. with some level of acceptable performance), people will simply stop looking at the high level code as the end result works, in the same way most people stopped looking at generated assembly after 8 bit computers (for example, as most games were written in raw assembly for... perforamance), as it was good enough.
> If instead I use an LLM to rewrite a feature of a codebase I can't be sure that it still functions like the original one.
Right now, with existing static analysis tooling, you can ask it to write a full suite of unit tests capturing existing behaviour without modifying the existing code with 100% code coverage, and start there. Plus fuzz tests as well. I actually have marginally more confidence in that than a human being doing it.
> Until very recently, I pored over every single line of code Claude generated with razor sharp scrutiny.
As LLMs generate better code in a higher level language (where better equals fewer defects, and does what you want), scrutiny of that code by humans will naturally drop. Human scrutiny will likely be replaced by something that doesn't exist yet, perhaps some sort of higher-order 'LLM linter', or Lean-esque language or tooling that somehow proves the LLM did the correct thing.
It's entirely possible in 2026, to further manually optimise compiler generated assembly, but vanishingly few people do that.
The point of my comment is that 'good enough' is almost here as demonstrated by the parent's comment.
> A fully deterministc compiler
Well, there's the rub. Humans and LLMs that asked to solve a problem at a higher level will rarely write the same code twice. Write the simplest regex, and you won't come up with this https://www.cs.princeton.edu/courses/archive/spr09/cos333/be...
The future is indeterminism.
Without bashing anyone in particular, a certain OS-vendor's desktop apps, have been 'good enough' to ship, but with p*ss-poor performance in many cases for the last decade or so. We crossed the 'good enough' Rubicon a few years back in terms of what end users receive as a finished app.
Hopefully LLMs will eventually bridge that last gap of efficiency when generating higher-level code that not only works, but is efficient. Maybe there's a future where they generate the final binary without even invoking a compiler.
Tell an LLM to break into its own system as part of a feed back loop, but with no context of the initial creation? It should iteratively get to 'safe' shouldn't it (subject to the tokens you want to spend)?