Comment by SirHackalot

That’s just not true. Google Brain/DeepMind came up with the attention mechanism to begin with… What a silly take.