Comment

Comment by bensyverson

Yes, I'd be really interested to see Fable / Opus / Sonnet.

GLM 5.3 Flash Max had an interesting showing. Its Codex version was bad [0], and it completed in 9 minutes. The OpenCode version was much richer [1] and more detailed, completed in 20 minutes. And the OMP version was arguably the most complete [2], completing in 30 minutes.

This is probably the strongest argument for the effect of a harness, and I'd be interested to learn the differences in the prompts and tools between these three.

[0]: https://alvins82.github.io/hangar-harness-model-tests/hangar...

[1]: https://alvins82.github.io/hangar-harness-model-tests/hangar...

[2]: https://alvins82.github.io/hangar-harness-model-tests/hangar...

parent bensyverson 1 month ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton