jmorgan

Joined 12 years ago

Karma
1,780
Submissions
179
Member since
Jan 31
https://github.com/ollama/ollama
View on Hacker News

Recent submissions

Comment · 4 months ago
The larger models are available on Ollama's cloud as most folks don't have the hardware to run 500B-1T parameter models.
Comment · 8 months ago
For local models I've been trying it with GLM-4.7-Flash and the new LFM2 24B model. I'm excited to try it with the new Qwen3.5 models that came out today as well.
Comment · 8 months ago
I've been using Pi day to day recently for simple, smaller tasks. It's a great harness for use with smaller parameter size models given the system prompt is quite a bit shorter vs Claude or Codex (and it uses a nice small set of tools by default).
Comment · 9 months ago
That's not good, sorry. I work on Ollama - shoot me an email ([email protected]) and we can help debug
Comment · 9 months ago
It's available (with tool parsing, etc.): https://ollama.com/library/glm-4.7-flash but requires 0.14.3 which is in pre-release (and available on Ollama's GitHub repo)
Comment · 10 months ago
Comment · 11 months ago
The gpt-oss weights on Ollama are native mxfp4 (the same weights provided by OpenAI). No additional quantization is applied, so let me know if you're seeing any strange results with Ollama.

Most gpt-oss GGUF files online have parts of their weights quantized to q8_0, and we've seen folks get some strange results from these models. If you're importing these to Ollama to run, the output quality may decrease.

Comment · 1 year ago
We did consider building functionality into Ollama that would go fetch search results and website contents using a headless browser or similar. However we had a lot of worries about result quality and also IP blocking from Ollama creating crawler-like behavior. Having a hosted API felt like a fast path to get results into users' context window, but we are still exploring the local option. Ideally you'd be able to stay fully local if you want to (even when using capabilities like search)
Comment · 1 year ago
Amazing work. This model feels really good at one-off tasks like summarization and autocomplete. I really love that you released a quantized aware training version on launch day as well, making it even smaller!
Comment · 1 year ago
It should open ollama.com/connect – sorry about that. Feel free to message me [email protected] if you keep seeing issues
Comment · 1 year ago
Sorry about this. Re-downloading Ollama should fix the error
Comment · 1 year ago
Working on adding tool calling support to Magistral in Ollama. It requires a tokenizer change and also uses a new tool calling format. Excited to see the results of combining thinking + tool calling!
Comment · 1 year ago
This is a great point. apt-get would definitely be a better install experience and upgrade experience (that's what I would want too). Tailscale does this amazing well: https://tailscale.com/download/linux

The main issue for the maintainer team would be the work in hosting and maintaining all the package repos for apt, yum, etc, and making sure the we handle the case where nvidia/amd drivers aren't installed (quite common on cloud VMs). Mostly a matter of time and putting in the work.

For now every release of Ollama includes a minimal archive with the ollama binary and required dynamic libraries: https://github.com/ollama/ollama/blob/main/docs/linux.md#man.... But we could definitely do better

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton