Comment Comment by dron57 Nor do they have to. Inference from different users is batched together. parent dron57 8 months ago