Comment
Comment by none_to_remain
A 20 tps Qwen3.8-27B at 2 bits quantization is limited but not useless. I've been putting one on "read this codebase and figure out XYZ" for me, where the typos are less consequential.
Be the first to share your thoughts.