Comment Comment by modeless Answering my own question, FP8 with BF16 accumulate is double rate already, but FP8 with FP32 accumulate is half rate, and this hack doubles it to match BF16 accumulate. parent modeless 5 days ago