Comment by enriquto

For a dryer, more formal and succinct approach, see "The Transformer Model in Equations" [0], by John Thickstun. The whole thing fits in a single page, using standard mathematical notation.

[0] https://johnthickstun.com/docs/transformers.pdf