Comment Comment by ilaksh I wonder when the antirez/ds4 group will have an update to their high accuracy 2 bit quant.Although it's funny that I am thinking about that at all because I have a 2060 :P . My local inference is playing with Gemma 4 E2B and MiniCPM 5 1B. parent ilaksh 3 months ago
Although it's funny that I am thinking about that at all because I have a 2060 :P . My local inference is playing with Gemma 4 E2B and MiniCPM 5 1B.