Comment Comment by hh1 When you talk about "c" or "scalar memory" in the paper, does that refer to a single unit in the vector usually referred to as c?So in mLSTM, each unit of the vector c is now a matrix (so a 3d tensor)? And we refer to each matrix as a head?Having a bit of issue understanding this fundamental part parent hh1 2 years ago
So in mLSTM, each unit of the vector c is now a matrix (so a 3d tensor)? And we refer to each matrix as a head?
Having a bit of issue understanding this fundamental part