Comment by terhechte

You can set a custom URL to use Ollama which is OpenAI API compatible. Llama3 8b runs quite fast for me on a M1 Max. I'll be making use of this feature I think (haven't tried it yet).