HuShifang
Joined 9 years ago
Joined 9 years ago
The "Ladder of Causation" proposed by Judea Pearl covers similar ground - "Rung 1” reasoning is the purely predictive work of ML models, "Rung 2" is the interactive optimization of reinforcement learning, and "Rung 3" is the counterfactual and casual reasoning / DGP construction and work of science. LLMs can parrot Rung 3 understanding from ingested texts but it can't generate it.
In any case, no, I certainly would not attribute to pigs human-level cognition. But certainly, the notion that language is a prerequisite for thought (at least up through the level of "solving a Sudoku puzzle", per some research) has been largely discarded [0]. And certainly, as omnivores (who will kill and/or consume members of their own species, occasionally including even their own offspring, as well as members of other species) I think it's reasonable to suppose that pigs would have an inkling that one being's death is another's meal. And fundamentally, there is ample reason to suppose that pigs are closer to human-like cognition than the vast majority of species on earth. (Anecdata: they make for difficult pets owing to their need for stimulation, they can play video games [1], and -- as any reputable animal scientist will tell you -- once you get past certain bare-minimum things like ending the use of gestation crates, the most important things for pig welfare in industry are not group housing or (beyond a certain point) extra space, but rather giving them toys and a sense of cleanliness via clean bedding.)
But feel free to provide evidence that attests that "[t]heir thoughts on death and loss will be similarly weak." I would certainly take it into consideration.
[0]: For a handy summary, see https://www.livescience.com/can-we-think-without-language
> BNNs bring the following advantages over GPs: First, training large GPs is computationally expensive, and traditional training algorithms scale as the cube of the number of data points in the time series. In contrast, for a fixed width, training a BNN will often be approximately linear in the number of data points. Second, BNNs lend themselves better to GPU and TPU hardware acceleration than GP training operations.
If I'm not mistaken Hilbert Space Gaussian Processes (HSGPs) are O(mn+m) (where m is the number of basis functions, often something like m=30, m=60, or m=100), which is also a huge improvement over conventional GPs' O(n^3). I know that there are some constraints on HSGPs (e.g. they work best with stationary time series, and they're not quite as accurate, flexible, or readily interpretable or tunable as conventional GPs), but what would be the argument for an AutoBNN over an HSGP? Is it mainly about the lack of a need for domain expert input?
https://github.com/pymc-devs/pymc-resources
(I think the author of the book discussed above, Osvaldo Martin, is the primary or sole contributor for the Rethinking implementations, in fact -- he had a full implementation in his own repo (https://github.com/aloctavodia/Statistical-Rethinking-with-P...) before deprecating it in favor of the above-linked one.)
The author was also a lead author on a CRC red-series book, Bayesian Modeling and Computation in Python Learning, published a few years ago (short review here):
https://academic.oup.com/jrsssa/article/185/Supplement_2/S76...