Comment by physPop

No. Even for large models that a good mental model. This is parroted all over and is wrong. Its not going to generate out of distribution answers. Its a probabilistic function of the training set.