Comment by bigdict

What's the point of the relu in the loss function? Its inputs are nonnegative anyway.