Comment Comment by mvf4z7 Basically Little's law. It is queues all the way down.https://en.wikipedia.org/wiki/Little's_lawAdditionally, here is a great talk on queuing theory and load shedding. One argument this talk makes is that autoscaling is not the silver bullet you think it is (similar to queues).https://www.youtube.com/watch?v=-oQl1xv0hDk parent mvf4z7 2 years ago
https://en.wikipedia.org/wiki/Little's_law
Additionally, here is a great talk on queuing theory and load shedding. One argument this talk makes is that autoscaling is not the silver bullet you think it is (similar to queues).
https://www.youtube.com/watch?v=-oQl1xv0hDk