Comment by JacobJack

Thank you for your responses. They've been very helpful. I'm going to test the llama.cpp binaries directly. That seems to me to be the closest to what Ollama is trying to achieve, after all.