Comment Comment by pickettd Looks like MLX quants are released:- 4bit: https://huggingface.co/mlx-community/QwQ-32B-4bit- 6bit: https://huggingface.co/mlx-community/QwQ-32B-6bit parent pickettd 1 year ago
- 4bit: https://huggingface.co/mlx-community/QwQ-32B-4bit
- 6bit: https://huggingface.co/mlx-community/QwQ-32B-6bit