Comment by andersonbcdefg

Hello! Yes, the other person who replied to you beat me to it, but this already works with any LLM provider that is OpenAI-compatible, via providing a custom API base URL. For hosted providers, this includes Together AI, Mistral, and I think even Google has an OpenAI-compatible endpoint for Gemini now. This should also work with self-hosted options like vLLM and Ollama. I led with OpenAI in the quickstart as this is the provider that most people are likely familiar with, and easiest to get started.