Comment Comment by throwaway314155 Wow, thanks for the info. I'm planning on testing this on my M4 Max w/ 36 GB today.edit:So looking here https://ollama.com/library/gpt-oss/tags it seems ollama doesn't even provide the MXFP4 variants, much less hide them.Is the best way to run these variants via llama.cpp or...? parent throwaway314155 11 months ago
edit:
So looking here https://ollama.com/library/gpt-oss/tags it seems ollama doesn't even provide the MXFP4 variants, much less hide them.
Is the best way to run these variants via llama.cpp or...?