Comment by simonw

32GB will run a good quantized Mixtral, though I can't confidently explain how much of a quality difference there is from unquantized.