Comment by kookamamie

I more relevant benchmark would be against TensorRT, the current kind of model serving performance on NVIDIA GPUs.