Comment

Comment by alephnerd

Parallel Distributed Processing (PDP) was a subgroup of CogSci and Neuroscience researchers who were using a neo-Connectionist approach to modeling cognition.

Geoff Hinton was a early member of this group of MIT, UT, UCSD, and CMU psychologists, CogScientists, and CS researchers

The core research of the PDP group is what became CNNs, which are what truly enabled LLMs (as most can trace their origins to the work done on BERT)

One of Hinton's earliest papers in the space: https://stanford.edu/~jlmcc/papers/PDP/Chapter1.pdf

parent alephnerd 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton