Comment by danielhanchen

Yes the higher the quant, the better! The other approach is dynamically choosing to upcast some layers!