brulard
Joined 11 years ago
Karma
559
Submissions
372
Member since
Oct 13
Joined 11 years ago
3090 gets 20-30 tokens a second for dense ~30B models (QwQ 32B, Gemma 3 27B Q4), similar to M3 ultra. If you are talking about Qwen3-Coder 30B (MoE), then both 3090 and M3 Ultra are around ~70 tok/s.
But even if you were right about the speed - which you are not - speed is pointless if you need large model that wouldn't fit into your VRAM.
Another non-negligible advantage of icon is, that it is language agnostic. Not everyone is fluent in language they have to use.