When Timnit Gebru described LLMs as "stochastic parrots", she was making a deep point about what she believed to be the limitations of the technology. Her argument claimed that while we perceived legible text coming from ChatGPT, we were actually being fooled by our innate pattern-matching instincts. Notably, at the time she wrote this, it wasn't uncommon to see LLMs collapse into piles of gibberish, lending credence the the idea that there was never any actual meaning in the output other than what we readers brought to it.
It's safe to say that argument has collapsed utterly. Modern LLMs virtually never collapse into endless babbling loops. Far more importantly, they solve objectively hard problems. An LLM didn't merely inspire a mathematician to spot a counterexample to the Jacobian Conjecture that had been in front of his nose the whole time; it found the counterexample. These things are unquestionably generating meaningful outputs.
(That obviously doesn't mean that you can simply trust LLM outputs!)
At this point, trying to dunk on frontier models by calling them "stochastic parrots" is saying more about you than about the models. Moreover, it suggests you're not only out on a limb about the capabilities of LLMs, but also on what even the skeptic literature about it was saying.
You should know what "stochastic parrot" actually meant; you shouldn't be using the term just because you think it sounds snazzy.
It's safe to say that argument has collapsed utterly. Modern LLMs virtually never collapse into endless babbling loops. Far more importantly, they solve objectively hard problems. An LLM didn't merely inspire a mathematician to spot a counterexample to the Jacobian Conjecture that had been in front of his nose the whole time; it found the counterexample. These things are unquestionably generating meaningful outputs.
(That obviously doesn't mean that you can simply trust LLM outputs!)
At this point, trying to dunk on frontier models by calling them "stochastic parrots" is saying more about you than about the models. Moreover, it suggests you're not only out on a limb about the capabilities of LLMs, but also on what even the skeptic literature about it was saying.
You should know what "stochastic parrot" actually meant; you shouldn't be using the term just because you think it sounds snazzy.