Comment Comment by latchkey https://chipsandcheese.com/2024/06/25/testing-amds-giant-mi3...Take that article and increase it by the gemm gains.At the end of the day, MI300x is outperforming an H100.More importantly is that you need 2xH100 to do 70B and only 1xMI300x. parent latchkey 2 years ago
Take that article and increase it by the gemm gains.
At the end of the day, MI300x is outperforming an H100.
More importantly is that you need 2xH100 to do 70B and only 1xMI300x.