Comment Comment by xrd Looks like no quantized options with llama.cpp?https://github.com/ggerganov/llama.cpp/issues/1602 parent xrd 3 years ago
https://github.com/ggerganov/llama.cpp/issues/1602