Comment by tartrate

Well, since it affects inference speed it means you can handle more in less time, needing less concurrency.