Comment

Comment by karmakaze

I did a similar thing running Q6_K model and Q8_0 DFlash2 (draft=7) quants:

    DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NM-DAU-NEO-MAX-MTP-GGUF
    incoai/Qwen3.8-27B-DFlash2-GGUF
using llama.cpp PR/commit https://github.com/ggml-org/llama.cpp/pull/27342 on an AMD R9700 (32GB)
parent karmakaze 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton