Comment Comment by throwa356262 The future is already here :)These 3bit ISTA quants of qwen are supposed to be 95% as accurate as the full model and runs moothly on laptops:https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUFThere are multiple independent tests of this on YouTube. parent throwa356262 22 hours ago
These 3bit ISTA quants of qwen are supposed to be 95% as accurate as the full model and runs moothly on laptops:
https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF
There are multiple independent tests of this on YouTube.