Thinking about how this may apply to AI, this research seems to be saying that the distribution of neurons is not a normal distribution, but more akin to the population of a country, where there are dense clusters of neurons amid a mostly sparse network, the same way populations heavily cluster in urban areas.
We don’t yet know the reason for that structure, but it appears across species and across different regions of the brain
It could be that a similarly modeled neuronal network would exhibit more pockets of specialized activity in response to certain inputs, and potentially even redundancies in specialization allowing it to process the inputs in slightly different ways to reach ensemble/consensus style outcomes. In some ways it sounds reminiscent of the mixture of experts approach
We don’t yet know the reason for that structure, but it appears across species and across different regions of the brain
It could be that a similarly modeled neuronal network would exhibit more pockets of specialized activity in response to certain inputs, and potentially even redundancies in specialization allowing it to process the inputs in slightly different ways to reach ensemble/consensus style outcomes. In some ways it sounds reminiscent of the mixture of experts approach
It’s certainly interesting!