Comment Comment by TomGarden GLM 5.3 Flash on 128GB Ram would have to be 2-bit right?I'm no expert but it seems the consensus is you get a suboptimal experience under 4-bit. Please correct me if I'm mistaken here parent TomGarden 16 days ago
I'm no expert but it seems the consensus is you get a suboptimal experience under 4-bit. Please correct me if I'm mistaken here