gyesxnuibh
Joined 1 year ago
Joined 1 year ago
Humans are non-deterministic when compared between humans. But if you give a human the same task they can be pretty consistent. Models quality varies much more than a single human does and human's reasoning don't reset with their context window. Otherwise tenure wouldn't matter, companies wouldn't try to retain specific talent, and pay bands wouldn't be so wide. But thanks for spelling it out.
I'm also not sure what humans being non-deterministic even means here. The point is if you're comparing results with NFR, pure agentic coding falls short.
I've never had this be a problem in reality but AWS has a pretty good backbone. Maybe if you were running it over a pretty unreliable network this would be an issue?
0: https://etcd.io/blog/2025/autonomus_testing_with_antithesis/
Usually organizational changes are massive efforts. But I guess hype is a hell of an inertia buster.
I don't think they're being snarky.
Also if you're organizationally changing the culture to force people to put more effort in writing the code, why are you even organizationally using LLMs...?
It doesn't say anything about what it's backed by.
I mean in my anecdotal evidence, AI has not been meeting bigger picture requirements and needs hand holding. Even on the newest models. So are you not experiencing that?
> I don't see why that's bad. If anything it's better for AI - way easier to say "always use at least Astra/Opus 5.5" than it is to fire your crap employees.
So you're saying you'd rather have AI make a consistently bad engineer inconsistently mid and a consistently good engineer inconsistently mid over what they usually are?
I much prefer consistency in my engineers. Especially when investing in them helps them improve.
And the reason I think it makes good engineers inconsistently mid is because look at the drop in quality as a customer from big tech which hires top talent. I had to cancel my Spotify subscription because it's become so sloppy.