Comment by gujk

At the that scale, CPU and developer time are mostly orthogonal. If you need to crunch 1000x more numbers, you won't be able to program your way out of the problem. If your code is 1000x inefficient, it should be easy to optimize a bit. If you really need 1000 machines for just one hour, setup costs dwarf compute costs. If you need 1000 machines for a year, you will need someone to administer the work and wrangle the data.