Comment Comment by andy_xor_andrew > This is a 30B parameter MoE with 3B active parametersWhere are you finding that info? Not saying you're wrong; just saying that I didn't see that specified anywhere in the linked page, or on their HF. parent andy_xor_andrew 11 months ago
Where are you finding that info? Not saying you're wrong; just saying that I didn't see that specified anywhere in the linked page, or on their HF.