Comment

Comment by vunderba

A better question would be over something like Jan or LibreChat. Ollama's is CLI/API/backend for easily downloading and running models.

https://github.com/janhq/jan

https://github.com/danny-avila/LibreChat

Jan's probably the closest thing to a open-source LLM chat interface that is relatively easy to get started with.

I personally prefer Librechat (which supports integration with image generation) but it does have to spin up some docker stuff and that can make it a bit more complicated.

parent vunderba 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton