Comment by albrewer

If I get a better Gemma 26b-a4b MoE model out of it I'm all for it. Really wishing Qwen 3.8 would release a MoE variant of their 27b model size, but I wont complain if google beats them to it.