Comment Comment by swimwiththebeat Does anyone know if this is using the Mamba architecture[1] instead of transformers? It looks like it uses a state space model (SSM) layer.[1]: https://arxiv.org/abs/2312.00752 parent swimwiththebeat 2 years ago
[1]: https://arxiv.org/abs/2312.00752