Comment by samatman

"Does it generalize past the training data" has been a pre-registered goalpost since before the attention transformer architecture came on the scene.