Comment by theGnuMe

There's another paper replacing attention with FF networks so just combine the two and you've got something.