Comment Comment by a20eac1d Any chance you could point me in the right direction on how to set something like this up?Right now, I'm using pure CPU Llama but only the 17B version, based on I believe llama.cpp. How do I mix both CPU and GPU together for more performance? parent a20eac1d 3 years ago
Right now, I'm using pure CPU Llama but only the 17B version, based on I believe llama.cpp. How do I mix both CPU and GPU together for more performance?