PSSA: A non-transformer language model written from scratch in Rust g github.com 91 sparticle62 1 month ago 38 comments
The backbone is also a selective SSM rather than an LSTM controller, so the sequence half is closer to Mamba than to an NTM. DNC comparisons are fair too, and I should have cited both in the readme.