Comment by p1esk

I glanced at these links and it seems that all these attention variants still use QKV projections.

Do you see any issues with my interpretation of them?