adipandas

I love how this comment turned a good old physics to a thread about existential reflections - folks debating the meaning of life. :D

I completely agree with you mate.

Learning quantization approaches in deep learning.

Beautiful idea.

My take on it: I find it difficult to generalize the notion of layer removal when the bit depth of that layer goes to zero. It's wouldn't be straight forward although the authors provide equation 5. It feels like lot of information is missing in this work to even reproduce it. And authors do only 1 case study.

I believe some implementation is required to understand the authors completely. Example, optimizer modification for layer when it is removed in training.

For now I am not working professionally on those. But I hope to start something.

This is a good resource. I have worked with Arduino and RPi a lot. I want to start going deeper and more detailed. Thank you for sharing this.