Comment Comment by jasonjmcghee > AlphaEvolve achieved up to a 32.5% speedup for the FlashAttention kernel implementation in Transformer-based AI models> In roughly 75% of cases, it rediscovered state-of-the-art solutions, to the best of our knowledge.> And in 20% of cases, AlphaEvolve improved the previously best known solutionsThese sound like incredible results. I'd be curious what kind of improvements were made / what the improvements were.Like, was that "up to a 32.5% speedup" on some weird edge case and it was negligible speed up otherwise? Would love to see the benchmarks. parent jasonjmcghee 1 year ago
> In roughly 75% of cases, it rediscovered state-of-the-art solutions, to the best of our knowledge.
> And in 20% of cases, AlphaEvolve improved the previously best known solutions
These sound like incredible results. I'd be curious what kind of improvements were made / what the improvements were.
Like, was that "up to a 32.5% speedup" on some weird edge case and it was negligible speed up otherwise? Would love to see the benchmarks.