Comment by fxj

After reading the article it seems to me that this is more like synaptic pruning where weak connections between neurons are eliminated in order to increase the efficiency of the neurons. Interesting to see that this also works for LLMs.

https://en.wikipedia.org/wiki/Synaptic_pruning