Comment Comment by buzzier For Windows:1. Binary build https://github.com/jaykrell/llama.cpp/releases/tag/12. Quantized model (7B/13B/30B) https://mega.nz/folder/UjAUES6Z#bGhKkyiZX3eRrn9HcxVVfA3. main.exe -m ggml-model-q4_0.bin -t 8 -n 128 parent buzzier 3 years ago
1. Binary build https://github.com/jaykrell/llama.cpp/releases/tag/1
2. Quantized model (7B/13B/30B) https://mega.nz/folder/UjAUES6Z#bGhKkyiZX3eRrn9HcxVVfA
3. main.exe -m ggml-model-q4_0.bin -t 8 -n 128