Comment by bpg_92

Pretty nice, I'm really interested in pipelines for deep learning at scale, they link to this article (https://blogs.dropbox.com/tech/2017/04/creating-a-modern-ocr...), if anyone has some other insights I'd be thankful. So far I used TensorRT to deploy to inference servers. But there is a lot of boilerplate and something like a 'load balancer' for DL networks would be very interesting.