Comment by mdp2021

How do you use this model locally, similarly to using `llama-server -m <model>`?

(I mean: outside direct or substantial use of Python, and running the Neural Network in the most efficient way.)