Comment by KKKKkkkk1

We're talking about algorithms for TPUs, which quietly quantize your float32 matrices to bfloat16 behind your back [0]. This is aimed at a crowd that doesn't care about stability.

[0] https://cloud.google.com/blog/products/ai-machine-learning/b...