Comment by bnegreve

This is debatable, SIMD instructions and GPUs are highly synchronized, yet they do help with scalability.