JacobJack

GFA Basic !… So many memories are coming back to me.

Thank you for your responses. They've been very helpful. I'm going to test the llama.cpp binaries directly. That seems to me to be the closest to what Ollama is trying to achieve, after all.

> And the comparisons in this post are not going to be running some 2.58-bit-gguf-in-ollama with a couple test prompts.

Genuine question : is there something fundamentally wrong with Ollama ?

I use Ollama because it is easy to set up and manage (and also because VLLM is not super Windows friendly).

I thought the main advantage of VLLM was better concurrency management (better batching).

But if the quality of the interference itself is an issue, then maybe I should reconsider my choice.

I'd really like to be able to use this 3B model on my little 4GB GPU card! It looks very capable for a reasonable weight. Maybe one day on HhuggingFace

Indeed... Today, Chrome simply removed uBlock Origin (and Redirector, which I use regularly in development). That's the last straw... Besides, I don't see how I can surf the web these days without uBlock Origin.

It's a way of using the English term "chat" while using the typically French article "Le". It reminds me of old American cartoons that abused the article "Le" to emphasize the French aspect of a character or place. The Mistral products "La Plateforme" and "Le Chat" follow this principle.

Yes... So many memories of the 90's are coming back to me all of a sudden. I spent months on Soundtracker/Protracker, literally.

After all, art may only be a matter of consensus.

No disqus account. So I’ll express myself here... MDN is an invaluable source of information. Very clear, comprehensive articles with intuitive examples. The web needs that.

Same here... Opera sets itself as default browser without any action/prompt whatever. It also adds the Opera icon in the task bar without asking anything. Red line crossed. Next step is probably to uninstall competitors ?