jklmnopqrstuvw

From my own testing, Claude/GPT is much faster than Deepseek.

From my own testing, Gemini 3.5/3.6 Flash is better than DS v4 Flash/Pro on text ability.

Months ago I start making this kind of test for my own reference. At beginning I I test each model multiple times, and results always same(pass or fail). Later I test only once for new models, I trust the results.

I don't think so. I specifically kept this PR to test model capabilities, and I've already tested a bunch of models. Current test results show that the more advanced the model is, the easier it passes. For example, GPT-5.5 Medium fails the test(has bug), but High passed.

Tested both DS v4 pro 0813 and Grok 4.6 (all from openrouter) on Codex cli. Worked on a same new feature development on my project.

Deepseek 4 pro: Worked for 12m 02s - cost $0.12 - has bug.

Grok 4.6: Worked for 3m 18s - cost $ 1.41 - no bug.

139 points in 50mins, why this news not in front page? got many downvotes?

From my own experience, GLM-5.2 generally cost more tokens and much more slow.

>Most larger orgs have to use API pricing AFAIK.

There are Business and Enterprise plans, both have discounting.

> A typical session for me with GPT is usually over a hundred dollars.

I don't think a $100 session is "typical". I use GPT for months. $20/m plus plan is enough for my daily work.

even with wal, postgresql can easily reach 130k tps in pipeline mode.

Gemini Omni