Comment by jdabney

We use 100 Gb EDR Infiniband to each host in our HPC clusters and with a combination of file system access, message passing, and general network traffic we actually use that bandwidth.