Comment Comment by sjnair96 Looks awesome. Do you know if and how you guys support NVIDIA's software. For my project the NVIDIA software I'm using states it needs:CUDA 11.3.0cuBLAS 11.5.1.101cuDNN 8.2.0.41NCCL 2.9.6TensorRT 7.2.3.4Triton Inference Server 2.9.0I'm new to deploying to production inference so I'm not sure if those are easily portable across such platforms or not really. parent sjnair96 5 years ago
CUDA 11.3.0
cuBLAS 11.5.1.101
cuDNN 8.2.0.41
NCCL 2.9.6
TensorRT 7.2.3.4
Triton Inference Server 2.9.0
I'm new to deploying to production inference so I'm not sure if those are easily portable across such platforms or not really.