Comment Comment by MacsHeadroom You link to Guanaco-33B, but Guanaco-65B is much more capable.CPU Version: https://huggingface.co/TheBloke/guanaco-65B-GGMLGPU Version: https://huggingface.co/TheBloke/guanaco-65B-HF4bit GPU Version: https://huggingface.co/TheBloke/guanaco-65B-GPTQ parent MacsHeadroom 3 years ago
CPU Version: https://huggingface.co/TheBloke/guanaco-65B-GGML
GPU Version: https://huggingface.co/TheBloke/guanaco-65B-HF
4bit GPU Version: https://huggingface.co/TheBloke/guanaco-65B-GPTQ