Comment by luizfelberti

This reminds me of this blog post[0] where they intercept calls to the CUDA API from one host to execute them in a separate host, essentially giving GPUs to VMs that have none, and allowing one GPU to serve multiple instances.

[0]: https://loopholelabs.io/blog/ollama-remote-gpu