abm53
Joined 6 years ago
Joined 6 years ago
Of course something like what you describe could happen. But under the central case, ensuring some privacy (with the ability to seek damages if breached) whilst still providing access to frontier models seems like a reasonable trade-off with a lot of value.
Perhaps the latest models change that relationship in a meaningful way.
In my experience they are mostly the subset of engineers who enjoyed coding in and of itself and ——in some cases—— without concern for the end product.
I certainly read it as one and found it funny.
But if true presumably it’s one of the usual reasons for observing data with low likelihood according to a model: misspecification or statistical bias/variance.
I’m not sure it’s really true in practice yet, but that would certainly be the claim.
That pattern is people complaining that a particular model has degraded in quality of its responses over time or that it has been “nerfed” etc.
Although the models may evolve, and the tools calling them may change, I suspect a huge amount of this is simply confirmation bias.
The most successful engineers are the ones who can accurately assess the trade-offs regarding those things. The things you list still may be critical for many applications and worth obsessing over.
The question becomes can we still achieve the same trade-offs without writing code by hand in those cases.
That’s an open question.
This is not really a point about whether LLMs can currently be used as English compilers, but more questioning whether determinism of the final machine code output is a critical property of a build system.
I suspect those using the tools in the best way are thinking harder than ever for this reason.
I’m not saying it won’t happen, I’m saying it’s outweighed for most by other concerns.