Comment by rationalData

It's literally statistics applied to data.

If your data is good and you can fit it to a model it will work.

The problem is that data is often poor and the idealized models don't fit real world conditions so you can have problems like overfitting.