Scaling a model on a chip is quite hard.
ChatJimmy is based on Llama 3.1 8 billion.
Kimi K3 has 2.8 trillion parameters.
That are 350x more parameters.
I would expect that Gemma 4 E2B (approx 5.1 billion parameters) or maybe even Gemma 4 26 billion A4B at some point is running on a chip.
I would expect that Gemma 4 E2B (approx 5.1 billion parameters) or maybe even Gemma 4 26 billion A4B at some point is running on a chip.