Comment by pzo

some other alternatives (a little more mature / feature rich):

anythingllm https://github.com/Mintplex-Labs/anything-llm

openwebui https://github.com/open-webui/open-webui

lmstudio https://lmstudio.ai/