phaedrus
Joined 18 years ago
Joined 18 years ago
I think there's a lot of parallel with experienced programmers using LLMs and that idea about steroids that it just gets you there faster. I'm pretty sure I could eventually program most of the things I've used AI to write, and what it produces at the top end I/you can't really prove that I wouldn't have thought of it. But is that really true?
I left that model with university which they kept as a display; I felt a little guilty having used up most of three Mindstorms sets for my project. Later I bought my own Mindstorms set, and then one of my then-wife's coworkers - whom we didn't know, and I don't know how she knew of me - randomly gave her a 2nd Mindstorms set to give to me. I keep meaning to re-create this dragon robot someday, leaner so it only takes two RCX. I have a lighter design now for the gripper + wrist section which, like the rocket equation, would allow the whole rest to be smaller if the last stage is smaller.
I wanted to throw a shoe at him. A static type check doesn't stand in for "a" unit test; static typing stands in for an unbounded number of unit tests.
Put another way, this common misconception by users of languages like Javascript and Python that unit testing is just as good as type checking (plus more flexible) is a confusion between the "exists" and "for all" logical operators.
Much like how Cosmic Inflation in the early universe left the imprint of microwave background radiation written exponentially large across the sky, I believe the exponential expansion of computing during the era of Moore's law left whole sections of scale in software not-fully-explored.
Specifically, as "average app sizes" went from 1K - 10K - 100K - 1M - 10M - 100M+, you could imagine the 1K-10K got fully explored because the space wasn't that big to begin with, and the 1M - 10M range got, if not explored at least inhabited, but it could be that that middle range of "neat applications that weigh in ~100K+ but less than 1M" didn't get completely explored because we didn't spend enough time in that era of computing.
A similar thing may be playing out in AI scaling, where we went from tiny to medium to huge model sizes, but now some new participants are going back and doing neat things with medium sized models.
The irony is in my day job I am developing a traditional downloadable Windows application which will come with an immediate user base. But although I have considerable discretion over the project, it isn't mine (in an intellectual property sense), and I'm not getting rich off it.
I am assuming the best thing I can do for it is lose weight, but that's easier said than done.
One might argue maybe a mixture of experts is just the best that can be done - and that it's unlikely the AGI be able to design new experts itself. However where do the limited existing expert problem solvers come from? Well - we invented them. Human intelligences. So to argue that an AGI could NOT come up with its own novel expert problem solvers implies there is something ineffable about human general intelligence that can't be replicated by machine intelligence (which I don't agree with).
One older coworker is quite enthusiastic about it (as a mechanical engineer, he designed some of the custom rigging), so perhaps this is a case where he does it because he wants to & demonstrated aptitude so they let him. He actually decided to on his own to stop when a recent near miss made him question "why the hell" he isn't leaving this to professional riggers.
I don't know how/why my younger engineer coworker ended up doing it. Both her parents are in this same field and I know she feels a lot of pressure to excel and not say no to things. And when we come out to help a site there's a lot of pressure to restore service. So she may have agreed or even volunteered but not for the right reasons.
It may though be a case where no one thought to mention to me that this isn't a required thing, that some are doing it because they want to, etc. My coworkers aren't always good at realizing what new employees don't know, and I'm not good at picking up nuance.
But I definitely was "voluntold" to go out to a site and cut cables, which is a specialty technique I'm not properly trained in and would've taken place outside in the elements. (Did I mention I'm a programmer, a profession I chose in part because it takes place indoors? I also have undiagnosed/self-diagnosed dyspraxia; it would have been a disaster.) Thankfully the trip got canceled for other reasons, but my point is I wasn't asked; I was just told we need to send someone so you're going.