Comment by _joel

You can run OpenAI compatible servers locally. vLLM, ollama, LMStudio and others.