Comment Comment by dheera They all do this marketing bull.Mixtral has an 8x7B model but it's actually 46.7B, not 56B params.Kinda similar to how 4K displays are 3840 pixels wide, not true 4K which would be 4096. Marketing people called it 4K, not engineers. parent dheera 2 years ago
Mixtral has an 8x7B model but it's actually 46.7B, not 56B params.
Kinda similar to how 4K displays are 3840 pixels wide, not true 4K which would be 4096. Marketing people called it 4K, not engineers.