Comment by nil-sec

I guess I was more thinking about self attention, so yes. The more general case is covered by your notation!