Comment by reustle

This looks great!

If you're looking to do the same with open source code, you could likely run Ollama and a UI.

https://github.com/jmorganca/ollama + https://github.com/ollama-webui/ollama-webui