Comment by gwern

But you aren't 'making decision's to pass gradients through them at all. It's just fixed random projections AFAICT (https://openreview.net/pdf?id=rkgNKkHtvB#page=3).