Comment by hwers

If price per compute keeps going down we effectively keep having moore’s law for parallel compute like GPUs. (Just get better at making ML models that don’t have as big of a communication bottleneck.)