Comment Comment by vanishingbee Happens in the very first example:[Attention is All You Need - 1:07]> Voice A: How did the "Attention is All You Need" paper address this sequential processing bottleneck of RNNs?> Voice B: So, instead of going step-by-step like RNNs, they introduced a model called the Transformer - hence the title.What title? The paper is entitled "Attention is All You Need".People are fooling themselves. These are stochastic parrots cosplaying as academics. parent vanishingbee 2 years ago
[Attention is All You Need - 1:07]
> Voice A: How did the "Attention is All You Need" paper address this sequential processing bottleneck of RNNs?
> Voice B: So, instead of going step-by-step like RNNs, they introduced a model called the Transformer - hence the title.
What title? The paper is entitled "Attention is All You Need".
People are fooling themselves. These are stochastic parrots cosplaying as academics.