Comment by nunja

Virtual envs are very practical for this as it does not mess up with the global python env. Also for inference / production, I just export my models to ONNX format which is more easy to work with thanks the available runtimes: ONNX Runtime for C++ or ONNX.js.