madlag
Joined 15 years ago
Karma
270
Submissions
61
Member since
Aug 1
Edtech Hacker
EX CTO @ Stupeflix
View on Hacker NewsJoined 15 years ago
https://arxiv.org/abs/2109.04838
Using blocks allows to keep good performence on GPUS, while giving some flexibility in the pruning pattern. And when removing entirely empty rows and columns the pruned matrices are actually pretty dense, so competitive with structured pruning for speedup, but less "aggressive" on the network during the pruning process. Disclaimer: I am the main co-author.