Comment by VHRanger

Yes, like RWKV and Mamba this is a new generation of models that are more like big RNNs than pure transformers we have now