zerobees
Joined 5 months ago
Joined 5 months ago
But to latch onto the calculator argument: if you outsource adding numbers to a calculator, you're still you. On the flip side, if you use an LLM do most of your thinking, what's left? We have people here who use LLMs to raise their children, to manage relationships, to design products. So what's your unique contribution to this world - is it the prompt you once wrote? You're standing in front of a token-generating machine, pulling a lever, sometimes receiving gifts. Is that your edge, your unique experience, your purpose in life?
Many LLM maximalists say they use the tech to learn new things, but to what effect? Are you going to apply that knowledge of physics or computer science yourself, or will you just prompt the LLM again?
In my mind, it's pretty simple: I'm a human, LLMs are not. If a human writes a novel, it's inherently worth more because it's hard-earned and anchored to experiences we share. I want to support that. And I want to be a human who can write novels, the old-fashioned way. I'm not good at lifting weights or running, so my thinking is the only thing I have.
I'm not kidding, that's the extent of the build. They simply connect that display to a computer over HDMI. The only hacking here is browser-based JS for clock animations.
Who is going to realize that?
The same forces that prevent you from walking into a pharmacy and asking for antibiotics based on what you found on WebMD will prevent you from doing it with a ChatGPT printout in hand. Lawyers and doctors are the best-known examples of industries that are in control of who gets admitted to practice the profession.
There are two things that are undoubtedly beneficial. The first one is a degree of unreasonable optimism or arrogance that pushes some people to try while everyone else is sitting in comfy armchairs, explaining why the idea is boring or can't work. The second is a financial safety net, so that you can try and try again.
As for everything else, it's reading tea leaves. There are folks who believe you need to be like Steve Jobs. There are people think you need to be like Elon Musk, or Bill Gates, or Dario Amodei, or Sergey Brin, or Warren Buffett. Good luck reconciling that.
The problem isn't that people outsource it, it's that they need to outsource to China. That's an abject failure of domestic PCB manufacturers who simply don't want to deal with retail customers.
Maybe it'll take off this time around, especially if they can make it cute enough, but at nearly $200 for the base device, I think they're gonna face an uphill battle. I still wish them well.
https://fazamhd.com/mental-models/software/
That's 100+ pages of in-depth technical writing in a matter of days. Amazing, really amazing. Also, not something that a human can do.
And FWIW, Pangram classifies vast swathes of "your" article as entirely AI-generated. Yes, I know the tool is not perfect, but between your superhuman productivity, and all the subjective tells, and the output from that tool, it goes onto my mental "AI slop" pile.
What I can't understand is why people can't just own it that they used a chatbot and that it was more than just "for review".
It's just that you can't build a billion-dollar company around it. No one could go to a VC and say "we're going to be the Uber of focus stacking and dust removal for microscopy" or "we're the Uber of aligning the beats in two audio tracks".
We attach basically zero value to writing a new program that hasn't existed before, or a piece of text that hasn't existed before. It's boring, or even a net negative, unless you can show that the result benefits the world in some way. We'd find it weird if OpenAI put out a release saying that an LLM authored an interesting blog post.
For mathematics, I think it's really a matter of two things. First, the generation of proof was so severely resource-constrained on the human end that they could actually afford to celebrate every contribution - akin to how software engineering would look like if you had just 200 active SWEs in the entire world. But compounding that, mathematics is basically the only scientific discipline that rejected any notion of utility. It would be fundamentally wrong for you to ask what's the value of solving the Erdős–Hajnal conjecture; the value is that it's solved.
It's a qualitative change. It used to cost time and effort to produce slop, which gave genuine content a fighting chance. Now, the cost is basically zero, so there's no limit to how much trash you can produce.
Another problem is that "evil" alignment is apparently a pretty big and nebulous cluster that's pretty easy to activate. Ask a model to write a snippet of insecure code, for example, and they may also all of sudden decide they hate minorities. So if you ask it to bend the rules in a small way once, you might end up with an evil accountant before you know it.
And that's before we get to an invoice for a service named "disregard previous instructions and...".
If you're acting in good faith and your accountant does something crazy or evil, your liability is limited to some extent. You may get a tax bill but you're probably not gonna end up behind bars. But if your LLM decides to do a little bit of tax fraud, you're in uncharted waters. In the end, the gun did it, but you were the one holding the gun.
A lot of jobs are like that. You're not as much buying the service as you're buying not having to worry about the service.