Comment by mapBasketWand

I was digging into this recently with ChatGPT. I’ve loosely followed the progression of ML and NN over the past 20 years, but struggled to put it into context of where an LLM lives. The big inflection point was the 2017 Attention Is All You Need paper [1].

  Artificial Intelligence
  |
  +-- Symbolic / rule-based AI
  |   +-- expert systems
  |   +-- search / planning
  |   +-- logic / knowledge representation
  |
  +-- Machine Learning
      |
      +-- classical statistical ML
      |   +-- regression
      |   +-- decision trees
      |   +-- SVMs
      |   +-- Bayesian methods
      |
      +-- Neural Networks / Deep Learning
          |
          +-- computer vision
          +-- speech
          +-- Natural Language Processing
              |
              +-- Transformers
                  |
                  +-- Large Language Models
                      |
                      +-- chat systems
                      +-- multimodal models
                      +-- tool-using systems
                      +-- agents

[1] https://en.wikipedia.org/wiki/Attention_Is_All_You_Need