Comment Comment by jasonjmcghee > mixtral works wellDo you mean mistral?mixtral is 8x7B and requires like 100GB of RAMEdit: (without quant as others have pointed out) can definitely be lower, but haven't heard of a 3.4GB version parent jasonjmcghee 2 years ago
Do you mean mistral?
mixtral is 8x7B and requires like 100GB of RAM
Edit: (without quant as others have pointed out) can definitely be lower, but haven't heard of a 3.4GB version