Comment Comment by yagizdegirmenci Google introduced this idea in 2022 with "FNet: Mixing Tokens with Fourier Transforms" [0].Later they found out that, performance of their TPU(s) for matrix multiplication was faster than FFT in the most scenarios.[0]: https://arxiv.org/abs/2105.03824 parent yagizdegirmenci 1 year ago
Later they found out that, performance of their TPU(s) for matrix multiplication was faster than FFT in the most scenarios.
[0]: https://arxiv.org/abs/2105.03824