Comment Comment by eth-mld https://github.com/NVIDIA/TransformerEngine - mixed precision FP8 is already here and provides similar accuracy to FP16/BF16 parent eth-mld 3 years ago
