Comment by colingauvin

I'm running it at 3 b.p.w. and it really feels better than Flash 4 at 4 b.p.w. for me. Some of these EXL3 calibrated quants are like magic.

It also has 196B ngram params that sit on disk. So it's really pretty comparable to GLM 5.3 in size.