Comment Comment by plasticsoprano Which quant do you use? I have a similar setup and the speed is atrocious at 4-bit. parent plasticsoprano 4 months ago