Comment by stochastic_monk

I think the best analogy is that ultrascale deep learning (if it’s not a term yet, it soon will be) is that of a particle accelerator: you throw as much firepower as possible at a task and get continued benefit.