thousandautumns
Joined 10 years ago
Joined 10 years ago
> Kean Birch is director of the Institute for Technoscience & Society at York University.
Academic sociologist argues that AI should be controlled by academic sociologists. Color me surprised.
I personally can find flat farmland quite beautiful, but I can imagine biking through it for days might get dull.
No one is trying to downplay the legitimately impressive results of AI/ML. Deep learning, convolutional neural networks and GANs have had incredible success in fields like computer vision, and image/speech recognition. But outside of those areas the "results" for the current fads in AI/ML learning have been grossly overstated. You have academic computer scientists like Judea Pearl decry the "backward thinking" of statistics and who are championing a "causal revolution", despite not actually doing anything revolutionary. You have modern machine learning touted ad nauseam as a panacea to any predictive problem, only for systematic reviews to show they don't actually out perform traditional statistical methods [1]. And you have industry giants like IBM and countless consulting companies promise AI solutions to every business problem that turn out to be more style than substance, and "machine learning" algorithms that are just regression.
There's a reason why AI research has gone through multiple winters, and why another is looming. Those in AI/ML seem to be more prone and/or willing to overpromise and underdeliver.
[1] https://www.sciencedirect.com/science/article/pii/S089543561...
I'm surprised how often this paper continues to get trotted out. In my experience it seems to be a favorite of non-statisticians who use it as evidence that statistics is a dying dinosaur of a field to be superseded by X (usually machine learning). Perhaps they think if its repeated enough it will be spoken into existence?
There isn't. This paper is nearly 2 decades old and isn't nearly as relevant as you would think given how many times it gets trotted out. Any statistician under the age of 45 would not recognize the two cultures as they are described here.
> Null Statistical Hypothesis Testing (NHST), another one of the pillars of STATS 101
Best practices of statistics and what is taught in Stat 101 are not remotely the same thing. The problems with R^2 and NHST have been well documented they've been argued against for decades by the statistics community. But actual statisticians make up a small proportion of statistics practitioners, as statistics is the backbone of nearly all modern science. What gets taught in Stats 101 is not the "foundations of statistical best practices" so much as "a system of guidelines and rules of thumb that have been simplified greatly for the sake of the lowest common denominator". To make things worse, non-statisticians seem to over-estimate their statistical knowledge and prowess after having taken a handful of introductory stats courses more than any applied field I know of.
Only now after the magnitude and pervasiveness of the replication crisis has begun to be recognized by the broad scientific community are people starting to realize what many statisticians have been pointing out for years.
> “It’s such a strange service — who wants to be in the cold? You need to hear about it from someone you trust,” said Michael Garrett, the head of Reboot, a spa that offers cryotherapy around the Bay Area. (Cryotherapy is when you make yourself get cold.)
There are plenty of arguments to be had about how the pharmaceutical industry operates and how/should they be regulated in ways that other industries aren't, but the idea that marketing budgets are the reason for high drug prices is moronic.
Similar AI endeavors have been underway for medicine and human health.
The author is making extremely shallow, flawed arguments that hinge on an ignorant (or possibly, deliberately narrow-minded) understanding of what generative AI is, how it is already being used, and the magnitude of what is already being achieved with it.