That's exactly what we do, the image is indeed driverless and we mount the host driver files as a volume (provided by our volume plugin) when the container is launched.
This way, you can launch a CUDA 7.5 container on any machine with driver version 352+
We provide more details here: https://github.com/NVIDIA/nvidia-docker/wiki/NVIDIA-driver Hope that helps!