Comment by arcanus

> The Hessian is too expensive and too big.

Not necessarily, often derivatives are analytically known in ML.

> MPI is not great at even high hundreds of cores

? You realize that Sequia, which I have run on, has codes that scale to all two million processors.