Comment Comment by techbruv Some other good resources:[0]: The original paper: https://arxiv.org/abs/1706.03762[1]: Full walkthrough for building a GPT from Scratch: https://www.youtube.com/watch?v=kCc8FmEb1nY[2]: A simple inference only implementation in just NumPy, that's only 60 lines: https://jaykmody.com/blog/gpt-from-scratch/[3]: Some great visualizations and high-level explanations: http://jalammar.github.io/illustrated-transformer/[4]: An implementation that is presented side-by-side with the original paper: https://nlp.seas.harvard.edu/2018/04/03/attention.html parent techbruv 3 years ago
[0]: The original paper: https://arxiv.org/abs/1706.03762
[1]: Full walkthrough for building a GPT from Scratch: https://www.youtube.com/watch?v=kCc8FmEb1nY
[2]: A simple inference only implementation in just NumPy, that's only 60 lines: https://jaykmody.com/blog/gpt-from-scratch/
[3]: Some great visualizations and high-level explanations: http://jalammar.github.io/illustrated-transformer/
[4]: An implementation that is presented side-by-side with the original paper: https://nlp.seas.harvard.edu/2018/04/03/attention.html