Comment by whimsicalism

yeah even the official flashattention is moving many implementations from cutlass to triton except for the main mha backward/forward pass