Comment by rhelz

If somebody finds patterns in them, that means they can be improved by reducing the patterns. Patterns and symmetry are forms of redundancy.

The less memory the weights take to meet a level of competency, the more random, and therefore patternless and inscrutable they will be.