Comment Comment by gwern Why is that any worse than, say, starting with randomly initialized weights in general? parent gwern 6 years ago