Comment Comment by InvOfSmallC For a super ignorant person:Both Llama 4 Scout and Llama 4 Maverick use a Mixture-of-Experts (MoE) design with 17B active parameters eachThose experts are LLM trained on specific tasks or what? parent InvOfSmallC 1 year ago
Both Llama 4 Scout and Llama 4 Maverick use a Mixture-of-Experts (MoE) design with 17B active parameters each
Those experts are LLM trained on specific tasks or what?