Comment by c0g

Surprised not to see a comparison to https://paperswithcode.com/paper/augmenting-self-attention-w...