Comment by kristianp

According to [1,2], MI210 Memory Bandwidth is 1,638 GB/s, vs RTX A6000 of 768.0 GB/s, that HBM2e at 4096 bits really beats GDDR6 at 384bits on bandwidth anyway. So I would expect the MI210 to have better utilization for bandwidth-heavy workloads.

[1] https://www.techpowerup.com/gpu-specs/radeon-instinct-mi210.... [2] https://www.techpowerup.com/gpu-specs/rtx-a6000.c3686