Comment by aarnphm

Hi there, 8bit and 4bit is currently supported on main. GPTQ is working in progress, as well as GGML