Comment by juggertao

And at memory stall they are exchanged with other waiting thread groups.

Just like HT.