Comment

Comment by yagizdegirmenci

Google introduced this idea in 2022 with "FNet: Mixing Tokens with Fourier Transforms" [0].

Later they found out that, performance of their TPU(s) for matrix multiplication was faster than FFT in the most scenarios.

[0]: https://arxiv.org/abs/2105.03824

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton