Comment by flounder3

Relevant PR: https://github.com/ggml-org/llama.cpp/pull/27742

This branch works now: https://github.com/unslothai/llama.cpp/tree/qwen4exp/qwen3.8...

  cmake -B build -DGGML_CUDA=ON

or

  cmake -B build -DGGML_METAL=ON

then

  cmake --build build --config Release -j --target llama-server llama-cli