It's about concurrency, not performance. What's the 95th percentile response time (backend only)?
Take out all that complicated code, and replace it with a call to an external 3rd party API. They get a hiccup, your response time goes up by 500%, your cpu load drops, and you start timing out connections.
Take out all that complicated code, and replace it with a call to an external 3rd party API. They get a hiccup, your response time goes up by 500%, your cpu load drops, and you start timing out connections.
C10M http://www.youtube.com/watch?v=D09jdbS6oSI