Comment by thomasahle

You can just do that my shaping the attention mask, no? That also gives you an actual guarantee that no information is leaked between conversations.