Comment by ma2rten

Interpretability research has found that Autoregressive LLMs also plan ahead what they are going to say.