Edit: for those who don't know, Parallel Distributed Processing (PDP) was a subgroup of CogSci researchers who were using a neo-Connectionist approach to modeling cognition.
Geoff Hinton was a early member of this group of MIT, UT, UCSD, Stanford, and CMU psychologists, CogScientists, and CS researchers
The core research of the PDP group is what became CNNs, which are what truly enabled LLMs (as most can trace their origins to the work done on BERT [edit 2: BERT is transformer based, not a CNN arch, though there was a CNN-BERT arch from a couple years ago that made a decent splash at ACL])
Edit: for those who don't know, Parallel Distributed Processing (PDP) was a subgroup of CogSci researchers who were using a neo-Connectionist approach to modeling cognition.
Geoff Hinton was a early member of this group of MIT, UT, UCSD, Stanford, and CMU psychologists, CogScientists, and CS researchers
The core research of the PDP group is what became CNNs, which are what truly enabled LLMs (as most can trace their origins to the work done on BERT [edit 2: BERT is transformer based, not a CNN arch, though there was a CNN-BERT arch from a couple years ago that made a decent splash at ACL])
https://mitpress.mit.edu/9780262680530/parallel-distributed-...