Comment by aaquibahm

why not mask attention and do it all in one forward pass ? tokens belonging to a question can just see that question and the main prompt