Comment by yshui

Any autoregressive model can do what you are describing. transformers are generating one token at a time too, not all at once.