>Pods communicate directly with one another on their pod IP addresses with MPI via SSH, not service endpoints.
this is super interesting. They are using mpi on kubernetes for their AI training i suppose.
So they are not using anything like kubeflow. Any idea which framework this is ?
The state of AI training on kubernetes is not so hot. And this would be a good learning. There is Ray Distributed today that claims a better performance (as well as a better developer experience) than OpenMPI - https://www.usenix.org/system/files/osdi18-moritz.pdf
this is super interesting. They are using mpi on kubernetes for their AI training i suppose.
So they are not using anything like kubeflow. Any idea which framework this is ?
The state of AI training on kubernetes is not so hot. And this would be a good learning. There is Ray Distributed today that claims a better performance (as well as a better developer experience) than OpenMPI - https://www.usenix.org/system/files/osdi18-moritz.pdf
wonder why the choices were made as such