Comment by dudisubekti

This is silly, people do inspect weights and prune/abliterate/whatever them

Also open weight models reveal their thinking, not to mention you can airgap the network around them.