Comment

Comment by throwaway314155

Wow, thanks for the info. I'm planning on testing this on my M4 Max w/ 36 GB today.

edit:

So looking here https://ollama.com/library/gpt-oss/tags it seems ollama doesn't even provide the MXFP4 variants, much less hide them.

Is the best way to run these variants via llama.cpp or...?

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton