Comment by option

autoregressive generation is memory bandwidth bounded