Comment by ac29

Yeah, I spent the last week with Deepseek Flash 4.1-1017, Kimi 3, and GLM 5.3 (and 5.3-flash). None of them were literally useless but also none of them were capable of making progress on the main project I am working on where Opus, Sol, and even Gemini Flash have all done very good work. Benchmarks might have you believe open models are only barely behind the big US labs in intelligence, but it feels much worse in practice.