Comment Comment by necubi It's 5B active params in MoE, not 5B total params (total is 137B). parent necubi 5 months ago
