Comment Comment by throwaway314155 > nearly unusable for 70b modelsCan Apple Silicon manage this? Would it be feasible to do with some quantization perhaps? parent throwaway314155 2 years ago
Can Apple Silicon manage this? Would it be feasible to do with some quantization perhaps?