Comment by LarsDu88

Their preprint showed it worked well with small batch size, but most prod deployments right now have rather large batch sizes from serving multiple users