Comment by greenavocado

So distribute copies of the model in RAM to multiple machines, have each machine update different parts of the model weights, and sync updates over the network