Comment by wint3rmute

Ollama was the easiest way to set up local LLMs for me.

https://ollama.com/