Comment Comment by TheAceOfHearts How do you decide what model variant to use? There's a bunch of Quant method variations of Llama-2-13B-chat-GGML [0], how do you know which one to use? Reading the "Explanation of the new k-quant methods" is a bit opaque.[0] https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML parent TheAceOfHearts 3 years ago
[0] https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML