Comment Comment by robotswantdata Why are you using Ollama? Just use llama.cppbrew install llama.cppuse the inbuilt CLI, Server or Chat interface. + Hook it up to any other app parent robotswantdata 7 months ago
brew install llama.cpp
use the inbuilt CLI, Server or Chat interface. + Hook it up to any other app