"Well, we handle it by Scaling Out."
Or by optimizing the code, switching to better algorithms, making better use of cache, etc.
"So, if the whole system is designed to Scale Out, one is in a relatively good position."
Not of the scale out overhead dominates the cost. A relatively recent, and widely read, article about this is at http://www.frankmcsherry.org/graph/scalability/cost/2015/01/... , titled 'Scalability! But at what COST?'. Quoting from it:
> Folks have gotten all wound-up about scalability, despite the fact that scalability is just a means to an end (performance, capacity). When we actually look at performance, the benefits the scalable systems bring start to look much more sketchy. We’d like that to change.
Or by optimizing the code, switching to better algorithms, making better use of cache, etc.
"So, if the whole system is designed to Scale Out, one is in a relatively good position."
Not of the scale out overhead dominates the cost. A relatively recent, and widely read, article about this is at http://www.frankmcsherry.org/graph/scalability/cost/2015/01/... , titled 'Scalability! But at what COST?'. Quoting from it:
> Folks have gotten all wound-up about scalability, despite the fact that scalability is just a means to an end (performance, capacity). When we actually look at performance, the benefits the scalable systems bring start to look much more sketchy. We’d like that to change.