omnicognate
Joined 13 years ago
Joined 13 years ago
2 is an interesting property and I agree that it's not possible for LLMs to possess it because it's a property of natural language itself, not the model. Not possessing it doesn't mean that LLMs can't be used to write software (obviously), but it does mean that using them isn't like using a compiler, which does have property 2. This is usually brought up in response to people claiming using LLMs is just another step in the process of increasing abstraction that led from punch cards to assembler to low level languages to high level languages*. That point stands: LLM use is qualitatively different to those steps because LLMs aren't "deterministic" in the sense of property 2.
There must be a better word for this, but I can't think of one right now.
* Even Linus Torvalds used that cockamamie framing just now: https://lore.kernel.org/lkml/CAHk-=whTs09_ozN+e09GU68N1wPP56...
(I assume you mean explain itself to humans here.)
I keep seeing people saying this as fact. It might, but it might not, and there are various reasons one might be skeptical that it will, using current techniques. Not least among these is that explaining something well to a human requires a degree of empathy and sophisticated theory-of-mind that LLMs have not yet exhibited yet*, and that is an area where humans are uniquely advantaged by being humans.
Someone will almost certainly reply by just stating as fact that they will achieve this goal, or pointing out that past predictions that LLMs wouldn't be able to do particular things have failed, and that's all very well. I certainly wouldn't be rash enough to claim it's impossible, but there are still models of all this available that are consistent with all the successes so far but don't predict "LLMs can do anything and will do everything". We'll find out in due course.
(I should clarify that the benchmark here is good human explanations. Of course many humans are capable of producing "explanations" worse than Markov chain text, let alone LLM output.)
* My idle speculation is that a lack of decent theory-of-mind is why LLMs still suck at using the "it's not X it's Y" construct. I doubt they actually use it any more frequently than humans when writing on the same topics, but they use it wrong and it's jarring. This particular rhetorical flourish works when there's some reason to think that X is an idea that might actually be present or forming in the mind of someone reading the passage (or in some other mind that they in turn might be imagining, eg. a fictional character), and that explicitly calling it out and negating it will have a particular dramatic effect. LLMs probably use it with about the expected frequency, but they use it for that reason (frequency) and then come up with something to put in the X and Y slots. The result often jars because the X it uses isn't something pertinent to the reader's thought process and/or the Y isn't a convincing, persuasive or relevant counterpoint to it. I suspect the result is that they stick out and seem more frequent than they are.
If I were a mathematician working on the Riemann Hypothesis, I'd probably be rather pissed off right now but continuing my work, i.e. the same as I am as a software developer.
That's why I'm not an artist.
In hindsight, along with illustrating the potential of computers as a bicycle for the mind it also gave the first indication that if such proofs were to become very easy to produce they could also be used as a bulldozer to bury the mind.
Grocery store owner A's revenue last year was €500,000. Its profit was €0. It does not have an IT department because it's a corner shop that employs 2 people and has one computer.
Grocery store owner B's revenue last year was €50,000,000,000. Its profit was €0. It has an IT department because it's a huge fucking corporation with a thousand massive stores, multiple office blocks, 150,000 employees and all of the networking and IT infrastructure an operation of that size needs. It's considering opening a bank.
The number that tells you the difference between the scales of these two companies is the revenue, not the profit.
I need to stop wasting my time on the pit of ignorance this site has become.
> Companies try to cheap out all the time, in incredibly stupid ways.
Yeah, and sometimes that results in someone turning their freezers into ovens. I don't think we disagree on this bit.