Comment by dwa3592

I have a prediction. By the mid of 2027, we will have >200B MoE models running on basic consumer hardware.

I am running Qwen3.6-35B-A3B locally on my 16GB mac with 7-9 tokens/second. Link - https://github.com/deepanwadhwa/samosa-chat

This is a GPT4 level model running locally with a decent speed on a 16gb ram macbook air.