Comment by exxo_

You need the NVIDIA drivers and the nvidia-docker plugin.

$ docker-machine create --driver amazonec2 --amazonec2-instance-type g2.2xlarge ...

$ docker-machine ssh <host> # install the NVIDIA driver and nvidia-docker-plugin

$ eval `docker-machine env <host>`

$ ssh-add ~/.docker/machine/machines/<host>/id_rsa

$ NV_HOST="ssh://ubuntu@<ip>:" nvidia-docker run mybuild/tensorflow

Step 2 can be skipped if you use a custom AMI.