Comment by throw0101d

If your workload can't actually use the whole (NVidia) GPU, it is possible to slice it up so that it can be shared between multiple users:

* https://docs.nvidia.com/datacenter/tesla/mig-user-guide/

* https://www.nvidia.com/en-us/technologies/multi-instance-gpu...

Or having multiple processes from one user share it:

* https://docs.nvidia.com/deploy/mps/index.html