Comment by cbkeller

That's how it works in any language on a supercomputer. MPI is pretty much the only game in town for inter-node communication.