Comment by MichailP

Is there a calculus based approach to statistics? Like understanding linear regression simply as a minimization problem, but ALL THE WAY ie extending to other statistical techniques?